(19) 



J 



(12) 



Europiisehes Patentamt 
European Patent Office 
Office europ^en des brevets 



(11) 



EP1 416 760 A1 



EUROPEAN PATENT APPLICATION 

published in accordance with Art. 158(3) EPC 



(43) Date of publication: 

06.05.2004 Bulletin 2004/19 

(21) Application number 02746149.0 

(22) Date of filing: 31 .07.2002 



(51) IntCiT: H04Q 9/00 

(86) International application number: 
PCT/JP2002/0d7791 

(87) International publication number 

WO 2003/015450 (20.02.2003 Gazette 2003/08) 



(84) 


Designated Contracting States: 


(72) Inventors: 




AT BE BG CH CY CZ DE DK EE ES Fl FR GB GR 


• IMAFUKU, Kazuo 




IE IT LI LU MO NL PT SE SK TR 


Kasuya-gun, Fukuoka 811-2414 (JP) 




Designated Extension States: 


• OKAMOTO, Naoko 




AL LT LV MK RO SI 


Itoshlma-gun, Fukuoka 819-1335 (JP) 


(30) 


Priority: 08.08.2001 JP 2001240814 


(74) Representative: Qriinecker, KInkeldey, 




0a08.2001 JP 2001240815 


Stockmair & Schwanhauaser AnwaltssozietSt 






Maximllianstrasse 58 


(7.1) 


Applicant: MATSUSHITA ELECTRIC INDUSTRIAL 


80538 MOnchen (DE) 




CO., LTD. 






Kadoma-shl, Osaka 571-8501 (JP) 





o 

CO 
CO 



(54) DEVICE CONTROL APPARATUS AND DEVICE CONTROL SYSTEM 



(57) An apparatus for controlling appliances con- 
nectable to a singular or a plurality of target appliances, 
which apparatus can be approached from a terminal de- 
vice. The apparatus comprises interface means for ex- 
changing signals with the appliances, memory means 
having program components folder which stores Inde- 
pendent program components by each of the functions, 
and application generation means which selects neces- 
sary program component among those stored in the pro- 
gram components folder to generate a certain specific 
application that confomns to the function of target appli- 
ance. Thereby, even when a new target appliance is 
added to, an existing appliance is changed or the con- 
trollable function of existing appliance is modified, the 
resultant burden levied on the users and system oper- 
ators is reduced. And in the present apparatus, the 
memory media resources are utilized efficiently with 
least wasting. 
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Description 

TECHINCAL FIELD 

[0001 ] The present invention relates to apparatus and 
system for controlling a plurality of electronic appliances 
(hereinafter refen^ed to as appliances) such as digital 
cameras and the like Imaging appliances, air condition- 
ing devices, microwave ovens and the like cooking ap- 
pliances, video equipment, digital video disc devices 
(DVD) and the like audio visual appliances, lamps and 
lighting facilities, printers, scanners and the like infor- 
mation processing devices, etc. through the internet, 
CATV or other networks using a temiinal device locating 
remote from the appliances. 

BACKGROUND ART 

[0002] A number of new technologies has been pro- 
posed for controlling the appliances installed at home 
or in office by means of a terminal devtee locating at a 
remote place. 

[0003] Anexampleoftherecenttechnologiesforcon- 
trolllng the appliances Is described referring to drawing. 
[0004] FIG. 53 shows the system structure of a con- 
ventional appliances control system. 
[0005] A terminal device 203 (personal computer, per- 
sonal digital assistant PDA, etc.) locating at a remote 
place contains bulit-In browser display means 215, and 
is ready for connection to a sen/er 205 via the internet 
202. 

[0006] A plurality of appliances 211 , which being the 
target of control, is connected to the server 205 installed 
at home or in office via a serial interface 204. 
[0007] The server 205 comprises a database section 
210, an interface section 201 for receiving/transmitting 
signals with the temninal device 203 via internet 202. and 
an appliances control section 207 for receiving/transmit- 
ting signals with the appliance 211 . The database sec- 
tion 210 already stores a control code tor making an ap- 
pliance 211 execute a control item, and a code (HTML 
code) written in the Hyper Text Markup Language 
(HTML document) used for exhibiting a control Web 
page to a user showing the target of control, control Item 
and procedure for issuing a control instmctlon, by each 
of the respective target appliances (hereinafter the con- 
trol code and the HTML code are collectively referred to 
as control application). 

[0008] When a user wishes to control an appliance 
211 from the terminal device 203, he or she makes ac- 
cess to the server 205 via the internet 202 requesting to 
send the HTML code needed for exhibiting a control 
Web page of the appliance 211 to the temiinal device 
203 out of the database section 210 via the interface 
section 201 . Then, the control Web page appears in the 
browser display means 215 of terminal device 203. 
[0009] The control Web page is exhibiting controllable 
functions with respect to a target appliance 211 as well 



as the contents of operation In the form of icon. User 
may select any one of the icons on the Web page to 
make an appliance 21 1 conduct a certain specific func- 
tion or operation. 
5 [0010] Upon selection of an icon by a user, a HTML 
code describing the selected function, operation is sent 
from the temiinal device 203 to the server 205 via the 
internet 202. The server 205 takes out from the data- 
base section 21 0 a relevant control code in accordance 
10 with what is described in the HTML code transmitted 
from the terminal device 203, and sends it to the appli- 
ance control section 207. 

[0011] The appliance control section 207 sends the 
control code to the target appliance 21 1 . The appliance 
211 executes what is described in the control code. 
[001 2] In the system for controlling appliances as de- 
scribed above, the users have been able to control the 
appliances 21 1 locating at remote places with respect 
to specified operation Items using a temiinal device 203 
(Japanese Laid-open Patent No. HI 0-51 674 is an ex- 
ample). 

[0O13] However, the following drawbacks have arisen 
with the above-descnlDed appliances control system; 
[0014] Namely, the control code and the HTML code 
of each of the respective appliances, as well as the im- 
age data needed for generating a GUI, have to be stored 
beforehand in the database section 21 0 of server 205, 
covering ail the target appliances. Therefore, the data* 
base section 210 is required to have an extremely vast 
memory region. 

[0015] Keeping entire control application such as the 
control code, the HTML code, etc. for each of all the con- 
trollable appliances in the database section 210 means 
that the similar programs such as the same control 
codes or the same GUIs are stored overiapped. This im- 
plies an inefficient use of the recording media resources. 
[0016] Furthennore, at every time when a new target 
appliance is added to, or an existing appliance is pro- 
vided with a new function or it is modified, new control 
code and new HTML code. etc. have to be added to the 
database section 210. 

[0017] For facilitating the above-described circum- 
stances of version improvement, new technologies 
have been proposed in which the necessary control 
code, etc. are downloaded to respective database sec- 
tions 210 from a separate server 205 provided on the 
network, at each time when a new target appliance is 
added to or modified (Japanese Laid-open Patent No. 
2001-53779 teaches an example). 
[0018] Even In the above system, however. It is far 
from practicable to download relevant data each time 
when a new appliance is introduced or the function is 
expanded, considering a recovery work needed for a 
possible error in the downloading operation, in addition, 
under the present status of prevailing communication in- 
frastructure, the downloading work takes a substantially 
long time. So, the repeated downloading operation can 
be a substantial burden for the users as well as for the 
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administrators. 

[001 9] Also for a person who is operating an applianc- 
es control system (system operator), it has been quite 
a toll to provide a new control Web page and amend the 
control code, HTML code, GUI, etc., at each time when- 5 
ever a new function is added to or modified with each 
appliance. 

[0020] I n an appliances co ntrol system having a home 
gateway (HGW) for the server 205 for controlling the ap- 
pliances 21 1 locating within a house, following addition- io 
al drawbacks have arisen. 

[0021 ] Appliances connected to a LAN are controlled 
by a remote tenninal device making access to a HGW. 
In order to make the control speed faster, or Increase 
the capability so that it can control more kinds of appli- is 
ances, the speed of processor built in the HGW needs 
to be increased and the speed of communication lines 
also need to be increased. The user is compelled to re- 
place the HGW with a new one and improve the com- 
munication lines at each time when he or she wishes to ^ 
increase the control speed. This has been creating a 
material burden for the ordinary users at home. 
[0022] The work of replacing the HGW, downloading 
a new software, improving the version of a browser soft- 
ware, and such other day-to-day maintenance work like 25 
data backup are not a simple. and easy job, which have 
been a big burden for the ordinary users at home. 
[0023] With the home-use HGW, there is a practical 
limitation, in view of cost and other factors, to the per- 
formance that can be expected in the HGW. Therefore. 30 
it has been difficult to implement a control concept that 
depends a substantial portion of the work for specifying 
a complicated operation or executing a sophisticated 
operation on the side of a processor built within a HGW. 

35 

SUMMARY OF THE INVENTION 

[0024] An apparatus for controlling appliances in ac- 
cordance with the present invention can be connected 

to a tenninal device and a singular or a plurality of target 40 
appliances. It comprises memory means for storing pro- 
gram components, with which components an applica- 
tion for making a target appliance execute a certain 
function is fomned, and application generation means for 
generating a certain specific application needed to ex- "^5 
ecute a selected function of the appliance, which gen- 
eration means selecting necessary program component 
among those stored in the memory means in accord- 
ance with an instruction issued by the terminal device 
for fomiing the application. 50 

BRIEF DESCRIPTION OF DRAWINGS 

[0025] 

55 

FIG. 1 shows the system structure of a system for 
controlling appliances in accordance with a first ex- 
emplary embodiment of the present invention. 



FIG. 2 Is a flow chart used to show a method of con- 
trol with a system for controlling appliances in the 
present invention. 

FIG. 3 shows the system structure of a system for 
controlling appliances in accordance with a second 
exemplary embodiment of the present invention. 
FIG. 4 shows a program components folder in the 
second embodiment. 

FIG. 5 shows an example of GUI in the second em- 
bodiment. 

FIG. 6 shows an example of GUI in the second em- 
bodiment. 

FIG. 7 is a flow chart used to show processing pro- 
cedure of a pan tilt button program In the second 

embodiment. 

FIG. 8 is a flow chart used to show processing pro- 
cedure of a pan tilt command program in the second 
embodiment. 

FIG. 9 shows an exemplary description of a pan. tilt 
command program in the second embodiment. 
FIG, 1 0 is a flow chart used to show processing pro- 
cedure of a zoom button program in the second em- 
bodiment. 

FIG. 1 1 is a flow chart used to show processing pro- 
cedure of a zoom command program in the second 
embodiment. 

FIG. 12 shows an example of users table in the 
present invention. 

FIG. 13 shows an example of target appliances ta- 
ble in the present invention. 
FIG. 14 shows an example of devices infomnation 
table in the present invention. 
FIG. 15 shows the system structure of other system 
for controlling appliances in accordance with the 
second exemplary embodiment of the present in- 
vention. 

FIG. 16 shows an example of program description 
for terminal distinction means in the second embod- 
iment. 

FIG. 1 7 shows the system stmcture of a system for 
controlling appliances in accordance with a thircl ex- 
emplary embodiment of the present invention. 
FIG. 1 8 shows an example of description for an ON/ 
OFF button display program in the third embodi- 
ment. 

FIG. 19 shows an exemplary GUI in the third em- 
bodiment. 

FIG. 20 shows an example of description for an ON/ 
OFF command program in the third embodiment. 
FiG. 21 shows an example of description for a pan 
tilt button program in the third embodiment. 
FIG. 22 shows a program components folder in the 
third embodiment. 

FIG. 23 is a flow chart used to show a method of 
control with a system for controlling appliances In 
accordance with a fourth exemplary embodiment of 
the present invention. 

FIG. 24 shows the system structure of a system for 
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controlling appliances In the fourth exemplary em- 
bodiment. 

FIG. 25 is an example of control command table In 
the present invention. 

FIG. 26 shows the system structure of a system for 5 
controlling appliances in accordance with a fifth ex- 
emplary embodiment of the present invention. 
FIG. 27 is an example of appliances profile table in 
the present invention. 

FiG. 28 is an example of registered appliances table io 
in the present invention. 

FIG. 29 is an exemplary layout drawing used to de- 
scribe the fifth embodiment. 
FIG. 30 shows an example of appliance-wise Web 
page in the present invention. is 
FIG. 31 shows the system structure of other system 
for controliing appliances in the fifth exemplary em- 
bodiment. 

FIG. 32 shows an example of Web page in an em- 
bodiment of the present invention. 20 
FIG. 33 is a flow chart used to describe processing 
steps for remote-controlling the appliances in an 
embodiment of the present invention. 
FIG. 34 shows correlation among the tables in the 
fifth embodiment. 25 
FIG. 35 shows the system structure of a system for 
controlling appliances in a sixth exemplary embod- 
iment of the present invention. 
FIG. 36 is an example of appliance-wise Web page 
in a seventh exemplary embodiment of the present 30 
invention. 

FIG. 37 is an example of appliance-wise Web page 
in the seventh exemplary embodiment. 
FIG. 38 is an example of clickable map data in the 
seventh embodiment. 35 
FIG. 39 is a flow chart used to show processing flow 
of a pan tilt script in the seventh embodiment. 
FIG. 40 is a flow chart used to show processing flow 
of specifying a complex control in accordance with 
an eighth exemplary embodiment of the present In- 40 
vention. 

FIG. 41 shows the system istructure of a system for 
controlling appliances in the eighth embodiment. 
FIG. 42 is an example of Web page in the eighth 
embodiment. 45 
FIG. 43 is an example of Web page in the eighth 
embodiment. 

FIG. 44 is an example of a selection page provided 
for specifying control Items in the eighth embodi- 
ment. , 50 
FIG. 46 is an example of a page provided for spec- 
ifying the details in the eighth embodiment. 
FIG. 46 is an example of a page used to confimri the 
specified contents in the eighth embodiment. 
FIG. 47 is an example of a page'used to confimi the 55 
specified contents In the eighth embodiment. 
FIG. 48 is an example of a page provided for exe- 
cuting a test in the eighth embodiment. 



FIG. 49 is an example of a table used to specify a 
complex control in the eighth embodiment. 
FIG. 50 is an example of vector data in a ninth ex- 
emplary embodiment of the present invention. 
FIG. 51 is an example of registered appliances table 
in the ninth embodiment. 

FIG. 52 is an example of layout drawing in the ninth 
embodiment. 

FIG. 53 shows the system structure of a conven- 
tional system for controliing appliances. 

BEST MODE FOR CARRYING OUT THE II^VENTION 

(Embodiment 1 ) 

[0026] FIG. 1 shows the system structure of a system 
for controlling appliances in accordance with a first ex- 
emplary embodiment of the present invention. 
[0027] A system for controlling appliances 501 in the 
present invention can control via a server 1 , which serv- 
er being the apparatus for controlling appliances, a plu- 
rality of appliances 3 (in FiG. 1 only one such appliance 
is shown) connected to the server 1 , using a temninal 
device 2 locating at a remote place. 
[0028] The appliances 3 and the server 1 are connect- 
ed through the internet or the like global network (here- 
inafter refen^ed to as WAN). 

[0029] An appliance 3 comprises a WWW sen/er or 
the like communication means 15 for receiving control 
command from the server 1 . and a module of control 
program 18 for operating the appliance in accordance 
with the control command received. 
{0030] The appliances 3 here include all kinds of such 
electronic appliances as IP cameras, digital cameras, 
digital video cameras, air conditioners, microwave ov- 
ens, television receiveTs, video recorders, printers, etc. 
that can receive control command delivered from the 
server 1 . 

[0031] The temninal device 2 can be a personal com- 
puter or a PDA, for example, which Is provided with 
browser display means 13 capable of exhibiting a Web 
page, and it is connected to the server 1 for mutual ex- 
change of infonmation via WAN 1 2. 
[0032] Server 1 comprises at least memory means 4, 
processing means 14 and interface means 11 . 
[0O33] For the memory means 4. a magnetic disc, a 
magneto-optical disc, a semiconductor memory device 
or the like readily available data storage means may be 
used. 

[0034] IVIemory means 4 stores a plurality of tables 
and folders. 

[0035] As an example of the tables, FIG. 1 2 shows a 
users table 8, FIG. 13 shows a target appliances table 
5, and FIG. 14 shows a devices infomnation table 7. 
[0036] The users table 8 contains infonnation needed 
for Identifying a user who is entitled to make access to 
the server 1 . Included In the infonnation for identification 
are, e.g. user ID, name, user name (log-in name), 
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amount of region available in the memory means 4 in 
server 1 , passwords and the like infomriation, as shown 
in FIG. 12. 

[0037] The users table may further contain a flag in- 
fonmation about services offered to users. For example, s 
a users table 8 shown in FIG. 12 contains a flag infor- 
mation as to whether or not a user wishes to have a serv- 
ice for cellular phone (in the table, it is referred to as 
control service through cellular phone), 
[0038] The target appliances table 5 contains, user- 
wise, such information as IDs of target appliances 3, ap- 
pliance names, URLs, nicknames of the appliances, 
ON/OFF state of the appliances, places where the ap- 
pliances are located, etc., as shown In FIG. 13. 
[0039] The devices information table 7 contains, as 
shown in FIG. 14, such appliance-wise information (by 
ID, appliance name, etc.) as the controllable functions. 
[0040] Now back to the FIG. 1 , the program compo- 
nents folder 6 contains, for each of the various control 
commands, those program components including a 
control command program 1 6 written in the PHP Hyper- 
text Preprocessor (hereinafter referred to as PHP) for 
transmitting the control comniand to the control program 
18 built in an appliance 3, and a button display program 
17 written in the Hyper Text Markup Language (HTML) 
for exhibiting a button GUI, etc. used for executing a 
control command in the browser display means 13 of 
tenninal device 2. Although only one set of a control 
command program 1 6 and a button display program 1 7 
is shown in the drawing, there are more sets of program 
components corresponding to each of the respective 
controllable functions. 

[0041 ] For the interface means 1 1 , generally-used in- 
terfaces, such as Ethernet, ISDN, ADSL, telephone line, 
serial or parallel interfaces, may be used. 
[0042] A plurality of appliances 3 (only one of which 
is shown in the drawing) is connected to the sen/er 1 via 
the interface means 11 . 

[0043] For the processing means 14, a readily avail- 
able CPU may be used. 

[0044] The processing means 1 4 is loaded with appli- 
cation generation means 9, which being a program for 
taking necessary information out of the above-de- 
scribed three tables and the program components to 
combine these into an application. 
[0045] . Next, a method of control with the system for 
controlling appliances 501 is described. 
[0046] FIG. 2 is a flow chart used to show a method 
of controlling the appliances in accordance with the 
present Invention. 

[0047] At step 31 02 in FIG. 2, a user makes access 
to server 1 by means of the browser display means 1 3 
of tenninal device 2. 

[0048] At step SI 03, the server 1 checks, using the 
application generation means, whether or not the user 
making access to is among those registered in the users 
table 8. The user identification may be conducted by a 
generally-practiced identification procedure using log-in 



name and password. If the user is confinned to be 
among the registered users, it proceeds to step SI 04. 
[0049] It is not the intention of the present invention 
to make any limitation to the method for identifying us- 
ers. For example, the identification can be conducted by 
means of biometrics when a user makes the log-in. 
[0050] At step SI 04, in response to the user making 
access to server 1 , the processing means 14 acquires 
information about the type of appliance 3 to which the 
user is entitled from the target appliances table 5. 
[0051] At step SI 05, the application generation 
means 9 generates, based on information acquired at 
SI 04, a picture asking the user to select a target appli- 
ance 3 among the plurality of appliances. The pteture Is 
displayed in the browser display means 13 of terminal 
device 2 via interface means 11 and WAN 12. 
[0052] At step SI OS, the user selects a target appli- 
ance 3 for the control. 

[0053] Then at step S1 07, the application generation 
means 9 acquires information, from the devices infor- 
mation table 7. about the kinds of controllable functions 
of the appliance 3 selected at S106. 
[0054] At step 1 08, the application generation mear^s 
9 acquires, from the program components folder 6, the 
program components relevant to the controllable func- 
tions of the target appliance 3; practically described, one 
program for each of the controllable functions, which 
program containing a set of the button display program 
17 and the control command program 16. 
[0055] At step 1 09, the application generation means 
9 generates a Web page, using the button display pro- 
gram 43 acquired at S108, showing a menu of control- 
lable functions with the selected appliance 3. The Web 
page is displayed in the browser display means 13 of 
terminal device 2 via network. 

[0056] At step S1 1 0, user selects contents of the con- 
trol he or she wishes. 

[0057] At step S11 1 , the processing means 14 exe- 
cutes a control command program 1 6 relevant to the 
function selected by user at step S1 10, which control 
program was already acquired at SI 08. Consequently, 
argument of control command, etc. is transmitted to the 
target appliance 3 via interface means 11. The appli- 
ance 3 receives the argument of control command, etc. 
at the communication means 15. and perfomris the se- 
lected item of control operation at the control program 
18. Thus a remote tenninal device 2 can make the ap- 
pliance 3 locating away from it conduct a controlled op- 
eration. 

[0058] Server 1 receives the result of control, at step 
S112. 

[0059] At step S1 1 3, rf the operation is finished or not 
is judged; if judged finished the operation is terminated. 
If judged not to have been finished, it retums to the step 
S110, where user selects the function. 
[0060] Thus the program components in the present 
invention may be provided function-wise; namely, they 
are independent from the difference in the type of appll- 
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ances 3. 

[0061] As described in the above, there is no need of 
installing a new control application, driver, etc. in the 
server 1 even when a new appliance is added to or the 

existing appliance is modified. Also, there is no need of 
providing a new Web page about operation of the appli- 
ance added to or modified. 

[0062] In a case where an existing appliance is pro- 
vided with an additional controllable function, only a pro- 
gram component related to the added function has to 
be added, and the database, etc. re-edited accordingly. 
There is no need of re-installing the control application 
and the driver, etc. 

[0063] Thus, as compared to the conventional sys- 
tems, the burden of users and system operators is alle- 
viated, at the same time It leads to the economy of mem- 
ory media resources. 

[0064] Although the server 1 and appliances 3, as well 
as the server 1 and terminal device 2, are connected by 
means of WAN 12 in the present embodiment, the con- 
nection between server 1 and appliances 3 or the con- 
nection between server 1 and tenninal device 2 may of 
course be made direct with a LAN, serial cable or USB, 
etc. 

[0065] Furthermore, a gateway, a router, etc. may of 
course be placed in the communication route between 
server 1 and appliances 3. 

(Embodiment 2) 

[0066] An example of remote-controlling an internet 
camera capable of transmitting still images (IP camera) 
using a system for controlling appliances in the embod- 
iment 1 is described as a second exemplary embodi- 
ment of the present invention. 
[0067] FIG. 3 shows the system structure of a system 
for controlling appliances 502 in accordance with a sec- 
ond exemplary embodiment. In FIG. 3, those constituent 
portions having the same functions as those of FIG. 1 
are represented by using the same symbols, and the 
description on which is omitted. 
[0068] In the system for controlling appliances 502, 
the memory means 4 is provided with a picture saving 
folder 10, and the IP camera 31 Is connected to server 
1 via WAN 12. 

[0069] An example in which the IP camera 31 is re- 
mote-controlled by the terminal device 2 for performing 
the "pan", "tilt" and "zoom" actions, and saving the still 
Images is described below. 

[0070] Method of the control is described referring to 
FIG. 2 once again. Steps from SI 02 through S104 re- 
main the same as In the embodiment 1 ; so, description 
of which steps is omitted here. 

[0071] At step 8105 In FIG. 2, an operation GUI as 
shown In FIG. 5 is exhibited in the tenninal device 2 at 
the browser display means 1 3. 
[0072] The illustration in FIG. 5 is telling a log-in user 
A that the user A is entitled to control IP camera 31 and 



IP air conditioner (not shown). The user A at tenninai 
device 2 is informed by the radio button that either IP 
camera 31 or IP air conditioner may be selected. 
[0073] At step SI 06 in FIG. 2, the IP camera 31 is se- 
5 lected as the target appliance through the radio button 
of GUI shown in FIG. 5. 

[0074] At step SI 07, the functions of IP camera 31 
with which the user A is entitled to control, or the oper- 
ation Information, are acquired. After the devices Infer- 
10 matlon table 7 of FIG. 14 and the users table 8 of FIG. 
1 2 are refen-ed to, it becomes known that the functions 
which the user A can control are the "pan", "tilt", "zoom" 
and "picture saving". 

[0075] At step 8108, the program components re- 
quired for controlling the IP camera 31 are Included, 
from the program components folders, into the applica- 
tion generation means 9 loaded to the processing 
means 14. 

[0076] The program components thus included con- 
tain the programs needed for performing the "pan", "tilt", 
"zoom" and "picture saving" actions, as shown In FIG. 
4. Those shown in FIG. 4 are part of program compo- 
nents included In the application generation means 9. 
among the program components stored in the program 
components folder 41 . 

[0077] For example, the picture save command pro- 
gram 44, the pan tilt command program 45 and the zoom 
command program 46 written in the PHP language are 
Included as the control command program 42. The pic- 
ture save button program 47, the zoom button program 
48 and the pan tilt button program 49 written in the HTML 
are included as the button display program 43 to the ap- 
plication generation means 9. 
[0078] In addition, the picture display program 50 is 
also included in the application generation means 9 as 
the program components. 

[0079] At step SI 09 in FIG. 2, the terminal device 2 
exhibits an operation GUI as shown in FIG. 6 at the 
browser display means 13. 

[0080] The operation GUI of FIG. 6 shows a zoom but- 
ton 61 for zooming the IP camera 31 , a pan tilt button 
63 for panning or tilting the camera, a picture save but- 
ton 62, name of the IP camera 31 and a picture display 
portion 64 for exhibiting the previously taken picture. 
[0081 ] The button display program 43 Included In the 
application generation means 9 at step SI 08 is em- 
ployed to exhibit the operation GUI of FIG. 6 in the ter- 
minal device 2 at the browser display means 13. 
[0082] Next, the operation of program components is 
described referring to the drawings, starting with the pan 
tilt button program 49. FIG. 7 is a flow chart showing the 
process flow of pan tilt button program 49; an exemplary 
description of the program is shown in FIG. 21. 
[0083] Referring to FIG . 7 at step S72, a pan tilt button 
63 appears on the operation GUI exhibited in the brows- 
er display means 13. 

[0084] At step S73, user makes an input (e.g. user 
designates an upward tilt). 
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[0085] At step S74, the direction of pan tilt (the argu- 
ment being Move = T) is sent to the pan tilt comnnand 
progrann 45, which being the control command program 
of pan tilt function, to complete the process flow of pan 
tilt button program 49. 

[0086] Next, process flow of the pan tilt command pro- 
gram 45 is shown in FIG. 8. 

[0087] FIG. 9 shows an example of the pan titt com- 
mand program 45 written in the PHP program. 
[0088] AtstepS81 in FIG. 8, the pan tilt command pro- 
gram 45 receives the earlier-described argument (Move 
= T], which argument being the result of processing per- 
fomried at the pan tilt button program 49. 
[0089] At step S82, the argument (Direction = TlltUp) 
is sent as the control command to the IP camera 31 via 
Interface means 11 . Thus it is finished. 
[0090] In the example of program as shown in FIG. 9; 
if move = T, then the @fopenC$devlceURLycgl-bln/Con- 
trolCamera?Directlon=TiltUP","r") ; Is executed. 
[0091] When, the $deviceURL is substituted by an ap- 
pliance URL described in the target appliances table 5 
of FIG. 13 (example: http7/a_kitchen_cam. devicecon- 
trolsystem.com). 

[0092] The IP camera 31 has in the cgi-bin directory 
of WWW server a control program, ControlGamera.The 
control program, GontrolCamera, receives the earlier- 
described argument (Direction=TiltUP) for execution. 
[0093] The IP camera 31 performs actual pan tilt ac- 
tion. 

[0094] Thus a temiinal device 2 locating at a remote 
place can control the IP camera 31 to make the pan tilt 
action. 

[0095] For making the IP camera 31 perfomn a zoom- 
ing action, similar procedures as those conducted ear- 
lier with the pan tilt button program 49 and the pan tilt 
command program 45 are followed. FIG. 1 0 shows proc- 
ess flow of the zoom button program 48, while that of 
the zoom command program 48 Is shown In FIG. 11 . 
[0096] Referring to FIG. 1 0, the zoom button program 
48 exhibits a zoom button 61 in the browser display 
means, at step S92. 

[0097] At step S93, upon receiving an Input from user, 
an argument of zooming (Zoom) is sent to the zoom 
command program 46 (at step S94), and It Is finished. 
[0098] Then In FIG. 11 , the zoom command program 
46 receives at step S11 the argument from the zoom 
button program 48. 

[0099] At step S12, if the target IP camera 31 is 
equipped with a zooming function is judged. If judged 
yes, the argument Is sent as the control command to the 
IP camera 31 . at step sV3, via interface means 11 , and 
it is finished. 

[0100] Upon receiving the control command 
(Zoom=zoom1), the IP camera 31 executes the control 
program to perform an actual zoom-In action. 
[0101] Like in the case of pan tilt action, a terminal 
device 2 at a remote place can control the IP camera 31 
also with respect to the zooming operation. 



[0102] An altemative structure may be implemented. 
Where, the application generation means 9 includes a 
digital zoom command program which executes digital 
zooming within the command program at step S14, If 
5 the IP camera 31 is judged at step SI 2 to have no zoom- 
ing function. 

[01 03] The processing in the above alternative struc- 
ture remains the same as before until step S1 1 ; so, the 
description on which portion Is not made here. 

10 [0104] Ref ending to FIG. 11, when zoom command 
program 46 receives the argument from zoom button 
program 48, the zoom command program 46 cuts out a 
certain part of the picture at step SI 4 and enlarges it; 
viz. the digital zooming. The digitally zoomed picture Is 

15 delivered as the output, and It is finished. 

[0105] Now, description is made on an example in 
which a picture shot by IP camera 31 is taken-in. A pic- 
ture save button 62 as shown in FIG. 6 is exhibited by 
the picture save button program 47. When the picture 

20 save button 62 is selected by user, a picture save com- 
mand program 44 is started to save the picture. The pic- 
ture can be stored In a picture save folder 1 0 in the mem- 
ory means 4 of server 1 . 

[0106] As described In the foregoing, a set of progracn 

25 components provided function-wise makes it possible ' 
to implement an apparatus and system for controlling 
appliances that works to be independent from the types 
of the appliances, In so far as the appliances can receive 
same control commands and arguments. Even in a case 

30 when a new appliance is added to or the existing appli- 
ance is modified, the server 1 does not need to be re- 
installed or re-downloaded with new control application, 
driver, etc. Furthermore; since the same button display 
program can be shared in common by those appliances 

35 having the same function, there is no need of installing 
or downloading a new program even when an appliance 
of different type is newly included for the control. Also, 
there is no need of providing a new operation Web page 
for the newly included or modified appliances. 

40 [01 07] By virtue of these advantages described in the 
above, the toils of downloading and installing of the soft- 
ware related to the newly included or modified appliance 
are minimized. This alleviates the burden of users and 
system operators, at the same time it contributes to the 

45 efficient utilization of the memory media resources. 
[0108] Although the picture save command program 
44, the pan tilt command program 45 and the zoom com- 
mand program 46 have been exemplified as the pro- 
gram components, and the picture save button program 

50 47, the zoom button program 48 and the pan tilt button 
program 49 have been exemplified as the button display 
program 43 in the present embodiment, it is not the in- 
tention of the present invention to limit the program com- 
ponents to the above-described items. 

55 [0109] For example, a resolution switching compo- 
nent (consisting of a resolution switching button display 
program and a resolution switching command program) 
for changing the resolution level of the IP camera 31 
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may be added to the control of IP camera 31 . 
[01 1 0] Furthemnore, taking a possible introduction of 
a remote control of IP camera 31 through an "inmode' 
or the like portable telephone unit Into consideration, 
there can be such program component as a picture cut 5 
out component (consisting of a picture cut out button dis- 
play program and a picture cut out command program), 
which component cuts a picture out in accordance with 
instruction given to the picture exhibited In the telephone 
unit or the like temiinal device. The above-described io 
concept of using such program components also falls 
within the scope of the present invention, the apparatus 
and system for controlling appliances. 
[01 1 1 ] Although the button display program 43 Is writ- 
ten in the HTI\^L document and the control command is 
program 42 in the PHP language in the present embod- 
iment, it is not the intention of the present invention to 
make any limitation to the language describing the pro- 
gram components. For example, those written with the 
CGI or other languages also fall within the scope of the 20 
present invention, the apparatus and system for control- 
ling appliances. 

[01 1 2] Considering the way of making access to serv- 
er 1 by means of a cellular phone, other portable tele- 
phone unit or the like terminal device 2, such access is 25 
increasing nowadays, the button display program 43 
may be provided in line with the browser display means 
13 built in the cellular phone or the like portable tele- 
phone unit; It may be provided, for example, In the MML 
document, HDML document, CHTML document, open 30 
contents document, etc. By so doing, the access to serv- 
er 1 will be made available for more varieties of tenminal 
devices 2, Including the cellular phones and the like port- 
able unit of other telephone systems. 
[0113] Furthermore, the terminal distinction means 35 
32, a software, may be loaded to the processing means 
14, together with the application generation means 9, 
as shown in FIG. 1 5, a system for controlling appliances 
503. In this system, the kind of browser display means 
13 of tenminal devices making access to the server 1 4o 
can be distinguished by the temiinal distinction means 
32. 

[0114] FIG. 1 6 shows an example of the program de- 
scription in the PHP language for the terminal distinction 
means 32. 45 
[01 1 5] If such terminal distinction means 32 finds the 
letters DoCoMo, for example, among temiinal infomria- 
tion delivered thereto, it employs in the subsequent pro- 
cedure a button display program 43 provided in advance 
specifically for the "i-mode". so 
[01 1 6] Other temiinal devices 2 likewise undergo the 
same distinctive procedure, and a button display pro- 
gram 43 that is written with a language con'esponding 
to the kind of browser display means 13 is employed in 
the subsequent procedure. 55 
[0117] In the above-described system In which the 
tenminal distinction means 32 is provided, the user is not 
requested to registerthe kind of terminal device 2 before 



he or she makes access to the server 1 from a cellular 
phone orthe like portable terminal devices. Upon receiv- 
ing an access from a terminal device, the system is 
ready to acquire information from the terminal device 2. 
Thus, various kinds of terminal devices can make ac- 
cess to,' and burden at the user side is further alleviated. 

(Embodiment 3) 

[0118] An apparatus for controlling appliances and 
the remote control system of the present invention is not 
limited to the control of I P camera 3 1 as described in the 
embodiment 2. It includes the control of all the electronic 
appliances that can receive the control command. 
[01 19] As an example of the above-described cases, 
the ON/OFF control of an air conditioner in the power 
supply perfomried from a remote tenninal device is de- 
scribed as a third embodiment. 
[0120] FIG. 1 7 shows the system structure of a sys- 
tem for controlling appliances in accordance with a third 
exemplary embodiment of the present invention. 
[0121] Those constituent portions having the same 
functions as those of FIG. 1 are represented by the 
same symbols, and the description on which Is omitted ' 
here. 

[0122] In the system for controlling appliances 503, 
an IP air conditioner 60 is provided with a WWW server 
for the communication nrieans 15, which server can re- 
ceive the control command delivered from the sen/er 1 . 
The IP air conditioner 60 is connected to the server 1 
via WAN 12. 

[0123] FIG. 22 shows part of the program compo- 
nents included in the application generation means 9, 
among the program components stored in the program 
components folder 71 . 

[0124] Refen-ing to FIG, 2 which shows the process 
flow in the method of controlling appliances in accord- 
ance with the embodiment 1, the program components 
included at step SI 08 in the application generation 
means 9 loaded to the processing means 1 4 are: an ON/ 
OFF button display program 75 for the button display 
program 73 and an ON/OFF command p'rogram74 for 
the control command program 72, as shown in FIG. 22. 
[01 25] FIG. 1 8 shows an exemplary description of the 
ON/OFF button display program 75, while FIG. 20 
shows that of the ON/OFF command program 74. 
[0126] Now back to the FIG. 2 once again to describe 
the method for controlling the appliances. The ON/OFF 
button display program 75 as shown in FIG. 18 is exe- 
cuted at step SI 09. As the result, a GUI as shown In 
FIG. 19 is displayed in the browser display means 1 3 of 
terminal device 2, asking for an instruction, ON or OFF 
the power supply. 

[0127] At step S1 1 0, when user selects the contents 
of a control (ON/OFF of the power supply to IP air con- 
ditioner 60, In the present example), the argument is 
sent to the ON/OFF command program 74 for execu- 
tion. 
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[0128] Describing more practically, If [ON] button is 
selected in the ON/OFF comnnand program 74 shown 
in FIG. 1 8, the data [ON] is sent to [location specified by 
URL] in the name [act]. In the [location specified by 
URL], the ON/OFF command program 74 is stored. 5 
[0129] In the OfM/OFF command program 74 which 
received the data [ON], the @fopenC$deviceURL/cgi- 
bin/Control?Action=ON'' , V) ; shown in FIG. 20, is ex- 
ecuted. 

[01 30] The $deviceURL here is the one that is shown io 
In the URL column of target appliances table 5; for ex- 
ample, 

http://a bedroom acn .devicecontroisystem.com. 
[01 31 ] Thereby, the Interface means 11 of server 1 re- 
quests the control program [Control] existing at the tar- is 
get IP air conditioner 60's directory [cgi_bin] to execute 
a command [Action=ONl (step S111 in FIG. 2). 
[0132] The IP air conditioner 60 executes the com- 
mand [Action=ON] In accordance with a bullt-ln control 
program to turn the power supply ON. 20 
[0133] Thus a terminal device 2 locating at a remote 
place can control an IP air conditioner 60. 
[0134] As described in the foregoing, what is deliv- 
ered from the server in the present invention to various 
appliances is the argument alone. The same program 25 
components can control the appliances of different 
types, in so far as the control relates to the same func- 
tion. Consequently, the size of necessary control pro- 
gram can be substantially reduced. 

30 

(Embodiment 4) 

[0135] In the foregoing embodiments 1 through 3 of 
the present invention, the location of control program 
built in the target appliance and the description of com- 35 
mand and argument have been given beforehand in the 
control command program 1 6. 
[0136] The present invention can be developed into 
another system structure for remote-controlling more 
appliances of various kinds. Such a structure Is de- 40 
scribed in detail as a fourth exemplary embodiment of 
the present invention, 

[0137] FIG. 24 shows the system structure of a sys- 
tem for controlling appliances in accordance with the 
fourth embodiment. Those constituent portions identical 4s 
to those in FIG. 1 or FIG. 3 are represented by the same 
symbols also in FIG. 24, and the description of which 
portion is omitted here. 

[0138] In a system for controlling appliances 505 
shown in FIG. 24, the server 1 is further provided with 50 
a control command table 81 in the memory .means 4. 
[0139] The control command table 81 stores such in- 
fomiation as the one shown In FIG. 25. 
[01 40] The control command table 81 stores, by each 
of the functions of respective remote -controllable appli- ss 
ances, information about the place where the control 
program of appliance is stored (e.g. directory informa- 
tion), and description of command to be transmitted as 



well as the argument. 

[0141] For example, one will understand by referring 
to FIG. 25 that: if an upward pan tilt is to be perfomned 
with an appliance [hcm10], a command [Direction=Tllt- 
Up] may be transmitted to the control program [Control- 
Camera] in the directory [cgi-bin] of [hcm10]. 
[0142] If such control command table is provided, 
contents of the control command program can be sim- 
plified. 

[01 43] A control command program stored in the pro- 
gram components folder 82 is written in the PHP lan- 
guage, and it may contain at least the following descrip- 
tion: 

@ f ope n ("$devlceU RL/$programpIace?$Control- 
command*, "r"). 

[01 44] Next description is made on a method for con- 
trolling the appliances using a system for controlling ap- 
pliances 505, which is provided with the control com- 
mand table 81 . 

[0145] FIG. 23 is a flow chart used to describe the 
process flow for remote-controlling the appliances using 
a system for controlling appliances in accordance with 
a fourth exemplary embodiment of the present inven- 
tion. 

[01.46] In FIG. 23. those process steps identical to 
those in FIG. 2 are represented with the same symbols, 
and the description of which is omitted hi ere. 
[0147] As compared with other embodiments, the 
point of difference of the method for remote-controlling 
the appliances shown in FIG. 23 Is that there is a step 
S114 for acquiring command information of appliance, 
inserted between step S110 and step S111 . 
[01 48] The newly added step S1 1 4 is described in de- 
tail. 

[0149] After a function is selected by user at step 
S110, the control command program refers, at the sub- 
sequent step S 11 4, to information in the control com- 
mand table 81 in accordance with the selected function. 
[01 50] If an appliance hcml 0, or IP camera 31 , is told 
to make upward pan tilt operation, the target appliances 
table shown in FIG. 13 is referred to the portion $device- 
URL, which being a variable of control command pro- 
gram reading, 

QfopenCSdevlceU RU$programptace? 
$Controlcommand" , V) ; and 

[http://a_kitchen_cam. devicecontrolsystem. 
com], or URL of the target IP camera 31 , Is placed. 
[01 51 ] By the reference to control command table 81 , 
the [cgi-b in/Control Camera], or the place of control pro- 
gram in IP camera 31. is placed in the portion [$pro- 
gramplace], furthenmore, the [Direction=TiltUP] is 
placed in the portion [$Controlcommand]. 
[0152] Then, the control command program actually 
executed at the subsequent step S1 11 is: 

@fopen (httpy/a kitchen cam. devicecontrolsys- 
tem. com/cgi-bin/ControlCame ra?Direction=TittUP 
" , V): 

[01 53] Thereby, a command accompanying the argu- 
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ment [Direction=TlltUP] is transmitted to the control pro- 
gram [ControlCamera] stored in the target IP camera 31 . 
Thus a specified action can be performed. 
[01 54] In the above-configured system for controlling 
appliances 505, more number of appliances 3 of various 
kinds, e.g. those having different control programs, can 
be controlled, by additionally writing in the control com- 
mand table 81 such information about the place of the 
control program, the control command and the argu- 
ment, etc, regarding the control programs built In the 
various kinds of appliances 3. 

[01 55] By so doing, burden of the users as well as the 
system operators can be alleviated, and the memory 
media resources can be used efficiently. 

(Embodiment 5) 

[0156] FIG. 26 shows the system stmcture of a sys- 
tem for controlling appliances In accordance with a fifth 
exemplary embodiment of the present invention. 
[01 57] A system for controlling appliances 506 in the 
present fifth embodiment can control a plurality of appli- 
ances 111 connected via a home gateway 110 (HGW) 
to server 101 (among them, only appliance 111 A, appli- 
ance 111 B, appliance 111C and appliance 111D are 
shown in FIG. 26); which HGW analyzes the network 
address of appliance control infomiatlon transmitted 
from a remote temiinal device 102 via the server 101, 
or the remote control device, and performs a routing op- 
eration to a targeted appliance in accordance with the 
network address. 

[0158] The appliances 111 and the HGW 110 fonn a 
local network 3 (hereinafter referred to as LAN). The 
HGW 110 and the server 1 01 are coupled via the inter- 
net or the like global network 4 (WAN). Each of the ap- 
pliances 111 has a WWW server or the like communi- 
cation means (not shown) for receiving the control com- 
rhand from server 1 01 , and a control program module 
(not shown) for executing the control command. 
[01 59] An Internet service provider (ISP) , a CATV pro- 
vider or the like service provider 124 may be placed be- 
tween the HGW 110 and the server 101, as shown In 
FIG. 31. 

[0160] Now back to the FIG. 26, the appliances 111 
here include all kinds of such electronic appliances as 
IP cameras, digital cameras, digital video cameras, air 
conditioners, microwave ovens, television receivers, 
video recorders, printers, etc. that can receive the con- 
trol command delivered from the server 1 01 . 
[0161] The temriinal device 102 can be a personal 
computer or a PDA, for example, which is provided with 
browser display means 1 1 3 capable of exhibiting a Web 
page. It is connected to the server 101 via WAN 104 for 
mutual exchange of Information. 
[0162] The server 101 includes at least a database 
section 1 05, a Web generation means 109 and an inter- 
face means 106. 

[01 63] The database section 1 05 is disposed in mem- 



ory means (not shown) of the server 1 01 . For the mem- 
ory means, a magnetic disc, a magneto-optical disc, a 
semiconductor memory device or the like readily avail- 
able data storage means may be used. The memory 
5 means stores at least two tables and one database. 
[0164]- As an example of the two tables, FIG. 27 
shows a profile table 107 describing respective appli- 
ances, and FIG. 28 shows a registered appliances table 
112. 

[0165] The registered appliances table 1 1 2 lists ail of 
the controllable appliances connected, and describes 
respective appliance ID, registered user ID, URL of con- 
trollable appliance (viz. network address of the appli- 
ance to be controlled), product ID, appliance name, lo- 
cation infomnation (the X, Y coordinates information, the 
floor indication of building in which the appliance is 
placed, etc.), flag infonmation about connection status, 
controlled state of appliance (in a case of camera, infor- 
mation on the pan tilt state), and other such Infomiatlon. 
[0166] The location information is referred when an 
appliance icon is displayed overlapped on an appliance 
layout drawing, details of which will be described later 
The location Infomiatlon teaches, for example, the val- 
ues in temns of the X axis and the Y axis in a layout 
drawing with the upper left comer as the point zero, and 
information about location within a building housing the 
appliances (in the registered appliances table 112 of 
FIG. 28, the floor number of building is indicated as the 
location floor). 

[0167] The appliances profile table 107 of FIG. 27 
stores, by type of the appliances, the infonmation about 
controllable functions, such as product ID, product cat- 
egory, product number, version, product name, .file 
name of product icon, function name and description of 
the control command, etc. 

[01 68] Now back to the FIG: 26 once again, the data- 
base section 1 05 further stores a visual map database 
106 (hereinafter referred to as visual map DB). 
[0169] The visual map DB 1 06 stores layout drawing 
indicating the place where target appliance 111 Is to be 
located. 

[0170] An example of such layout drawing stored In 
the visual map DB 106 is shown in FIG. 29. 
[0171] The visual map DB 106 stores a two-dimen- 
sional bit map Infonmation of layout drawing 1 91 , which 
provides a two-dimensional room layout indicating a 
place where an appliance 111 is to be located. 
[01 72] The layout drawing 1 91 may be provided either 
by saving the one prepared by a user on the Web, or by 
scanning an Image using a scanner 
[0173] Or, the visual map DB 106 may store a so- 
called drawing system vector data for each of the ob- 
jects, such as relative location of respective rooms in 
the layout drawing 1 91 . This point will be described later 
once again. 

[01 74] For the layout drawing 1 91 , a bit map informa- 
tion such as the one in the BMP form read out by a scan- 
ner, etc. may be used as it is. Or, the one converted Into 
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the DXF or the like vector data, after analyzing the bit 
map infonnation, may be stored. The above-described 
structure wilt be described later in a ninth embodiment. 
[0175] Refening to FIG. 26, the interface means 1 08 
can be a generally-used interface, such as Ethernet, IS- 
DN, ADSL, telephone line, serial or parallel interfaces. 
This enables the server 101 to exchange signals with 
the external appliances 1 1 1 and the terminal device 1 02. 
[0176] The processing means (not shown) of server 
101 has been loaded with Web generation means 109, 
which takes necessary infonnation out of the earlier-de- 
scribed two tables and visual map DB 1 08 and combines 
them to generate a Web page for controlling the appli- 
ances 111. 

[01 77] For the processing means, a readily available 
CPU for use In a personal computer or workstation may 
be used. 

[0178] Next, operation of the system for controlling 
appliances 506 Is described. 

[01 79] FIG. 33 is a ffow chart used to describe a meth- 
od of remote-controlling the appliances with the system 
for controlling appliances 506. ^ 
[0180] The tables shown in FIG. 34 remain the same 
as that shown In FIG. 28. FIG. 34 is intended to describe 
the relationship in data reference between partly-simpli- 
fied registered appliances table 1501 and appliances 
profile table 1503. In the following description, both FIG. 

33 and FIG. 34 are referred. 

[0181] At step 81102 in FIG. 33, user makes access 
to server 101 using a terminal device 102 through the 
browser display means 113. 

[0182] At steps 1103, upon the access to server 101 

made by the user, all the inf omnation about the applianc- 
es 111 to which the user is entitled to control is read out 
of the registered appliances table 112 to be kept at the 
Web generation means 109 loaded to the processing 
means. 

[0183] Describing practically; suppose the user mak- 
ing access to server 1 01 at step S 1 1 02 has a registered 
user ID [3], the registered appliances table 1501 In FIG. 

34 is searched at the column of registered user ID with 
the [3] as search key (region AA). As the result, an ex- 
tracted table 1 502 is provided. In this way, the applianc- 
es available for the user to control are extracted. 
[0184] At step S1 1 04, the Web generation means 1 09 
reads-in a layout drawing showing the appliance loca- 
tion as shown in FIG. 29, fomi the visual map DB 106. 
[0185] At step S1 105, the icon of appliances 111 are 
displayed overlapped on the layout drawing, on the ba- 
sis of Infomiatlon acquired at step S1 103 and S1 104. 
Thus a Web page as shown in FIG. 32, for example, is 
generated by the Web generation means 109, asking 
the userto select a target appliance among the plurality 
of appliances 111 . The Web page is exhibited in the ter- 
minal device 1 02 at browser display means 1 1 3, through 
interface means 108 and WAN 104. 

[0186] Describing practically, the Web generation 
means 109 makes reference to the appliances profile 



table 1503 at step S1105. using the product^ise ID of 
controllable appliances (region BB) stored in the extract- 
ed table 1502 of FIG. 34 as the search key. The Web 
generation means 1 09 acquires the file name of k:on Im- 

5 age, and the appliance icon image in database section 
1 05 acquires the icon images of respective target appli- 
ances from the storage directory. 
[01 87] The Web generation means 1 09 makes refer- 
ence to location infonnation at the extracted table 1 502, 

10 such as location X, location Y and location floor, etc. (re- 
gion DD), and then, based on the location infonnation, 
exhibits the acquired icon images of respective appli- 
ances overiapped on the layout drawing of FIG. 29. 
[01 88] At step S1 1 06 In FIG. 33, user selects a target 

15 appliance 111. 

[Ql 89] At step S 1 1 07, the Web generation means 1 09 
reads-in the information about the appliance 1 11 select- 
ed at step S1 106, viz. product name, singular or plural 
function names, singular or plural control commands, 

20 etc., from the appliances profile table 1 07. 

[01 90] At step S1 1 08, the Web generation means 1 09 
generates an appliance-wise Web page as shown in 
FIG. 30, for example, which shows menu of controllable 
functions with the selected appliance 111 . It Is exhibited 

25 in tenninal device 1 02 at the browser display means ' 
113. 

[0191] At step S1 109, user selects the content of a 
function for control, on the appliance-wise Web page. 
[0192] At step S1110, a control command for Imple- 

30 menting the function selected at S1109 is transmitted 
from the appliances profile table 107 to the target appli- 
ance 111 through interface means 108. The target ap- 
pliance 111 receives the control command at communi- 
cation means (not shown), and executes it at the control 

35 program module. 

[01 93] Thereby, a certain specific functional operation 
is perfonmed at the appliance 111. Thus a user can con- 
trol an appliance 111 with respect to a certain specific 
function, using a tenninal device 102 locating at a re- 

40 mote place. 

[01 94] At step S1 1 1 1 , server 1 01 receives the results 
of control operation, transmitted from the target appli- 
ance 111 . 

[0195]^ At step S 1112. if the operation is finished or 
45 not is judged. 

[0196] If judged finished, the operation is ended. If 
judged not to have been finished, it is returned to the 
step S1109, where user makes selection on the Web 
page picture. 

50 [0197] Since the layout drawing showing the place 
where appliances are placed has been stored in the vis- 
ual map DB 1 06, and the appliance U RL and the location 
infonnation, which being networi< address infonnation 
for specifying selectable appliances, have been storedi 

55 in the registered appliances table, layout of appliances 
can be exhibited in a two-dimensional mode as shown 
in FIG. 32 on a Web page, asking for selecting an ap- 
pliance. In the system for controlling appliances 506, us- 
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er can select a target appliance 1 1 1 easier at a first sight. 
[01 98] I n the system for controlling appliances 506 of 
the present invention, a temiinal device 102 locating at 
a remote place makes access to the sen/er 101. not 
HGW 110. This is a point of difference as compared with 5 
a conventional system for controlling appliances. 
[0199] infomiation about the appliances 111, viz. 
product name, singular or plural function names, singu- 
lar or plural control commands, etc. are stored totally in 
the server 101. io 
[0200] This means that the maintenance work such 
as updating, addition, modification of control com- 
mands, etc. is made by an administrator of the server. 
Each of the individual users Is not requested to do data 
maintenance regarding those accumulated in the HGW is 
1 1 0. Thus the burden of users is alleviated. 
[0201 ] Furthennore, since a HGW 1 1 0 is not request- 
ed to store the control command, etc. of target applianc- 
es 1 11 , It Is not necessary for the HGW 1 1 0 to Iceep large 
memory means. So, the HGW 1 1 0 can be stmctured 20 
simple. As a result, a simplified system for controlling 
appliances can be implemented, which system depend- 
ing less on HGW 1 1 0. Thus, users will not be compelled 
to renew the HGW 110 very often. 

[0202] In the examples of present embodiment, there 25 
has been a HGW 1 1 0, or a couple of HGW 1 1 0 and serv- 
ice provider 124, intervening between the server 101 
and the appliances 111. However, It is not the intention 
of the present Invention to limit the stmcture to the 
above-described configurations. For example, the serv- 30 
er 1 01 and the appliances 111 may be connected direct 
by WAN 104, these n/er 101 andthe appliances 111 may 
be connected by a service provider 124 alone, or the 
server 101 and the appliances 111 may be connected 
by means of an ordinary LAN using nornial cables or 35 
optical cables, or direct by serial, parallel, USB, etc. 
[0203] In the exemplary structure, the server 1 01 and 
the tennlnai device 102 have been connected via WAN 
104. However, the server 101 and the tenminal device 
102 may be connected by means of an ordinary LAN 40 
using nomial cables or optical cables, or direct by serial, 
parallel, USB, etc. 

[0204] Still further, other gateway, router, etc. may of 
course be placed in the communication channel be- 
tween the server 101 and the appliances 111, or be- 45 
tween the server 1 01 and the temnina! device 1 02. 

(Embodiment 6) 

[0205] An example of remote-controlling an intemet so 
camera capable of transmitting both the still images and 
the moving pictures (hereinafter referred to as IP cam- 
era) using a system for controlling appliances in accord- 
ance with the embodiment 5 is described practically in 
more details as a sixth exemplary embodiment of the ss 
present invention. 

[0206] FIG. 35 shows the system structure of a sys- 
tem for controlling appliances in accordance with a sixth 



exemplary embodiment of the present invention. In FIG. 
35, those constituent portions having the same func- 
tions as those of FIG. 26 or FIG. 31 are represented by 
using the same symbols, and the descriptions on which 

are omitted. 

[0207] • In the system for controlling appliances 507, a 
database section 1 05 is provided with a picture save da- 
tabase 1 52, and an IP camera 1 51 is connected to HGW 
110 to fomi a LAN 103. The HGW 110 is connected to 
sender 101 via WAN 104. 

[0208] The IP camera 151 is mounted with a control 
program module 153 and a still image output program 
module 154. 

[0209] Now in the present embodiment 6, description 
Is made on an example where the IP camera 1 51 is con- 
trolled for performing the "pan" and "tilt" to generate still 

images. 

[0210] Operation, of the system for controlling appli- 
ances Is described referring once again to FIG. 33. 
Steps from S1102 through S1 104 remain the same as 
in the embodiment 5; so, the description of which steps 
is omitted here. 

[0211] At step S1 105 in FIG. 33, Web generatiori 
means 1 09 mal<es reference to the layout drawing In- 
fomnation stored in visual map DB 1 06 and the location 
information of target appliance 111 stored in registered 
appliances table 112, and provides a Web page having 
an operation GUI as shown in FIG. 32. The Web page 
can be seen In terminal device 102 at the browser dis- 
play means 113. 

[0212] In FIG. 32, an IP camera 182, an IP FAX 183, 
an IP light 184 and an IP air conditioner 1 85 are shown 
in the form of icon overlapped on the layout drawing 1 81 . 
[0213] At step S1106 in FIG. 33, user designates a 
target appliance by selecting the appliance icon exhib- 
ited In FIG. 32. the Web page. 
[0214] An icon of IP camera 182, for example, is se- 
lected. 

[021 5] At step S 11 07, the Web generation means 1 09 
reads-in the infonnation needed to control the IP camera 
1 51 ; for example, function name and control command, 
etc., from the appliances profile table 107 using the 
product-wise ID of IP camera 151 as the search key. 
[0218] At step S1 108, an appliance-wise Web page 
of target appliance as exemplified in FIG. 30, generated 
by the Web generation means 1 09, is made available in 
temiinal device 1 02 at the browser display means 113. 
[0217] The appliance-wise Web page in FIG. 30 
shows, In the left alley, a remote control section for con- 
trolling the IP camera 151, viz. pan tilt button 161 for 
conducting pan or tilt with the IP camera 151, image 
quality adjust button 1 62 for adjusting quality of the im- 
age, resolution switching button 163 for switching the 
resolution level, and closing button 164 for closing the 
appliance-wise Web page, etc. in the space In the right, 
information received from the IP camera 151 , a still im- 
age 1 66 in the present case, is exhibited. 
[0218] Suppose an instruction for panning to the left 
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is selected (pan left button 165 In FIG. 30 is selected), 
the relevant control command is searched among those 
Infonnatlon related to the target IP camera 151 stored 
in the appliances profile table 1 07, using function name 
as the search key. s 
[0219] When making the IP camera 151 perfomri a 
pan left action, for example, appliance infomriation about 
the I P camera 1 51 is extracted out of the appliances pro- 
file table 107 of FIG. 27; vl2. the Infomnation stored in 
the first line thereof. Among the Information thus extract- 
ed, the corresponding control command [/nphControi- 
Camera? Directions PanLeft] is selected (control com- 
mand 9), using function name [panleft] (function name 
9) as the search key. 

[0220] This is a control command telling to send an 
argument [Direction=PanLeftl to the control program 
module 153 [nphControiCamera] built in the IP camera 
151 , or the target appliance. 

[0221] The control command Is transmitted to the IP 
camera 151, accompanied by an appliance URL which 
being network address information for specifying a tar- 
get appliance, viz. the IP camera 1 51 , in the present ex- 
ample, selected from among the registered appliances 
table. 

[0222] Now back to the FIG. 33, the control command 
is executed at step S1110, as described earlier. In prac- 
tice, the argument [Direction=PanLeft] is sent to the con- 
trol program module 153 [nphControiCamera] built in 
the IP camera 151. 

[0223] When, at the target I P camera 1 51 , the [Direc- 
tion=PanLeft] is executed at the control program module 
153 [nphControiCamera]. The IP camera 151 performs 

a pan action for 1 step to the left. 
[0224] At step S1 1 11 , the server 1 01 receives the re- 
sult of the control. 

[0225] Whether the operation is finished or not is 
judged at step S1 11 2. If it is judged finished, the opera- 
tion is ended. If judged not to have been finished, it is 
retumed to the step 1 1 09, an appliance-wise Web page 
which asks user to select an operation. 
[0226] Thus a temninal device 1 02 locating at a re- 
mote place can control an IP camera 151 . 
[0227] In the above system for controlling appliances 
507, since the layout drawing showing the place where 
appliances are placed has been stored In the visual map 
DB 106, and the layout infonnation about selectable ap- 
pliances has been stored in the registered appliances 
table, layout of appliances can be exhibited in a two- 
dimensional mode as shown in FIG. 32 on a Web page, 
asking for selection of an appliance. The user can select 
a target appliance 111 easier at a first sight for control- 
ling it from a remote place. 

[0228] As compared with a conventional system for 
controlling appliances, the access from a remote temii- 
nal device 1 02 Is made to server 1 01 , not HGW 110, and 
all the infomnation about appliances 111 , namely, prod- 
uct name, singular or plural function names, singular or 
plural control commands, etc. are stored in the server 



101 . This means that updating, addition, modification of 
control commands, etc. is made by an administrator of 
the server. Each of the individual users is not requested 
to do data maintenance regarding those accumulated in 
the IHGW 110. Thus the burden of users is alleviated. 
[0229]. Furthermore, since a HGW 1 1 0 is not request- 
ed to store the control command, etc. of target applianc- 
es 111, it isnotnecessaryfortheHGWIIOto keep large 
memory means. So, the HGW 110 can be structured 
simple. As a result, a simplified system for controlling 
appliances can be implemented, which system depend- 
ing less on HGW 110 in the processing capacity. Thus, 
the needs for often renewing the HGW 1 1 0 can be less- 
ened. 

(Embodiment 7) 

[0230] In a system for controlling appliances in ac- 
cordance with the present Invention, appliances 111 lo- 
cating at remote places are operated through a server 
101. The appliances are remote-controlled with respect 
to the functions which are controllable by the built-in pro- 
gram module. The concept of the present invention fur- 
ther enables to make the appliances perfonn a complex 
operation, or a combined control of the above functions, 
which operation was conventionally difficult to perfonm. 
In the present seventh embodiment, an example of such 
complex operations is described practically. 
[0231] In a seventh exemplary embodiment of the 
present invention, description is made on an example 
where the pan tilt actions are controlied through a click- 
ing applied on an actual picture taken by an IP camera 
151 during control procedure of the embodiment 6. 
[0232] This is an example where a sen/er 101 con- 
ducts a multi-step pan tilt with an IP camera 151 provid- 
ed with a controllable function of 1-step pan tilt action. 
P233] The system structure of a system for. control- 
ling appliances in the present embodiment 7 remains 
the same as that of embodiment 6, so the description of 
which Is eliminated here. 

[0234] Operation of the system for controlling appli- 
ances in the present embodiment is described with ref- 
erence to FIG. 33, which was used in the embodiment 
6. The process steps from S 1 1 02 through 81 1 07 remain 
the same as before, so the description of which part is 
omitted here. 

[0235] At step S1108, an appliance-wise Web page 
as shown in FIG. 36 is exhibited, which Web page is 
fonned of a still image 1 66 taken and saved beforehand 
with the IP camera 151 and a clickable map called 
imagel inlaid therein. 

[0236] The exhibited still image 1 66 is divided verti- 
cally into 9 and horizontally into 7, making a total of 63 
blocks. Each of the blocks is specified with respective 
number of change steps. There is a description in the 
HTML document needed to exhibit an appliance-wise 
Web page that the specified number of change steps is 
handed to a script written in the PHP language (an ex- 
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ample here is: [psnapindex.php3]), which transmits the 
pan tift control command to the camera upon clicking on 
any one of the blocks. Thereby, the IP camera 151 can 
be controlled to execute a multi-step pan tilt from a re- 
mote place. More practical description follows. 
[0237] The still image 166 is exhibited in a remote- 
controlling user temninal device 1 02 at the browser dis- 
play means 113 by an <IMG> tag, which reads 

<IMG SRC='http://cam01_usera.lp_servlce.com/ 
SnapshotJPEG?Resolution= 320x240 'usemap= 
•#image1' ismap>. The clickble map inlaid in the image 
is assumed to have a name, '#image1'. 
[0238] Referring to the drawing meshed as shown in 
FIG. 37, an example of clk:kable map data '#lmage1' of 
region A is shown in FIG. 38. 
[0239] In the above clickable map data, that of region 
B (hereinafter referred to as clickable data) is written in 
the following manner 

<area cords= '000, 000, 050, 025* href='psnaplndex. 
php3?P=-3&T=4&C =cont&camurl=http:// 
cam01_usera.ip.service.com&Resolution=320x240'> 
[0240] When the top left edge of the Image Is clicked, 
the argument after the ? is handed over to the PHP lan- 
guage script [psnaplndex.php3], and executed accord- 
ingly. 

[0241] In the above data, the P=-3 signifies executing 
the panleft for 3 steps. The T=4 is executing the tlltup 
for 4 steps. C=cont means that the Image was clicked 
on. In this case, It means that It Is In the pan tilt control 
mode. 

[0242] Next, detailed description is made on the script 
[psnapindex.php3] (pan tilt script). The pan tilt script 
contains a description of the process flow as shown in 
FIG. 39. 

[0243] At step S1601, a judgement Is made as to 
whether It is pan tilt mode or not. Practically, whether or 
not there is a description C=cont In the clickable data is 
judged. 

[0244] At step SI 602, whetherthe specified pan is to- 
wards the right or the left Is Judged. Practically, whether 
the variable P in clickable data has a positive value or 
not is judged. 

[0245] If the value P Is Judged to be positive at step 
S1 602, then the variable N Is subistrtuted with the abso- 
lute value of P, and the value of counter Count Is sub- 
stituted with 0, at step S1 603. 

[0246] At step SI 604, a control command accompa- 
nying an argument Direction=Pan Right is sent from 
server 101 to the control program module 153, nphCon- 
trolCamera, In accordance with a control program built 
in the IP camera 151 , which Is written as shown below 
in the PHP language : 

@fopen(''$camurl/cgi-bin/nphControlCamera?Direc- 
tion=PanRight", V). 

[0247] The $camurl Is a network address infomriatlon 
specifying IP camera 151, and it is substituted with a 
URL of the IP camera 1 51 selected from the registered 
appliances table. 



[0248] At step 31 904, the counter Count is increment- 
ed. At the subsequent step 81 605, if a variable N is 
greater than the counter Count or not is Judged. If Yes, 
it proceeds to step S1 605; if No, It Is returned to the step 

5 S1604. 

[0249] Namely, the IP camera 151 repeats the pan- 
ning action for the number of times the user wishes to. 
[0250] The above-described procedure from step 
31603 through step 31605 Is the pan right process. If 
10 at step S1 602 the pan is indicated to be towards the left, 
viz. the value of variable P is negatwe, then it follows a 
pan left process described at step S 1 606. 
p)251 ] The pan left process at step 31 606 is the same 
asthatof theeariler-described pan right, except thatthe 
following program is executed at the step 31 604: 

@fopen('*$camurl/cgi-bin/nphControlCamera? 
Dlrectlon=PanLeft" , V) . 

The panning action is perfomried leftward forthe number 
of times the user wishes to. 

[0252] Next, at step 31607, a tilt process is per- 
formed, which process basically proceeds In the same 
manner as those for the pan right and pan left. 
[0253] The processing contents for the tilt are the 
same as those for the pan right and the pan left. Forthe 
till upward, for example, the [Direction=TiItUP] is sent to 
the control program; while a command [Direction=Tilt- 
Down] is sent for the downward tilt. The remaining pro- 
cedure remains the same, so the description of whtoh Is 
omitted here. 

[0254] At step SI 608, a still image from the IP camera 
151 is taken in forthe display in the picture. In practice, 
the contents of following description are executed: 

<IMG SRC='$camuri/cgi-bin/SnapshotJPEG? 
Resolution= 320 x 240 & Quality =Standard' usem- 
ap='#image1 ' ismap>. 

[0255] With the above description, a command ac- 
companying the argument [Resolution=320x240&Qual- 
ity=Standard'usemap='#{mage1'ismap] is sent to the 
target IP camera 151 at the still image output program 
module 154 [SnapshotJPEG], and the pan tilt script Is 
ended. 

[0256] The present invention allows a server 1 01 to 
provide an appliance-wise Web page, in which the ear- 
lier-described clickable mapping, for example, can be 
freely written. 

[0257] Even in such a case where an IP camera 151 
itself is provided with only a 1-step pan tilt function, for 
example, the present invention makes it possible to 
make the target appliance 1 1 1 perfonn a multi-step pan 
tilt action at one control action. 
[0258] In the present embodiment, the description for 
exhibiting an appliance-wise Web page is the HTML 
document, and the pan tilt script has been written in the 
PHP language. However, it is not the intention of the 
present Invention to make any limitation to the languag- 
es used. For example, those written with the CGI or oth- 
er languages of course fall witiiin the scope of the 
present invention, the apparatus and system for control- 
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ling appliances. 

[0259] Taking the recently-increasing way of making 
access to server 1 by means of a cellular phone or the 
like portable temiinal device 2 Into consideration, if the 
Web pages or the appliance-wise Web pages are written 5 
in the MML document, HDML document, CHTML docu- 
ment, open contents document, etc. in confomnity with 
the browser display means 1 3 built in cellular phone or 
the like terminal devices, the access to sen/er 101 wlli 
be made available from more kinds of terminal devices 
102 including the ceiiuiar phones and the like portable 
tenminai devices. 

(Embodiment 8) 

[0260] In a system for remote-controlling appliances 
in the present invention, a Web page showing the icon 
of target appliance overlapped on, for example, a two- 
dimensional sketch of room interior structure is exhibit- 
ed. This facilitates a user to readily instruct, at the first 
sight of such Web page, plural appliances to perform a 
coordinated action in their respective functions. For ex- 
ample, telling to turn a room lamp ON as soon as soon 
as an IP camera detects a moving object. Or, an oper- 
ation by plural appliances, for example, turning a lamp 
of sen/ice entrance ON whenever a entrance lamp is 
turned ON, can be specified. In the following description, 
contents of such a control are refenred to as a complex 
operation. 

[0261 ] An example of specifying a complex operation 
to be perfomned by a plurality of target appliances using 
the apparatus and system for controlling appliances in 
the present invention is described below, as an eighth 
exemplary embodiment of the present invention. 
[0262] FIG. 40 Is a flow chart used to show a process 
flow for remote-controlling the appliances in the present 
embodiment 8, while FIG. 41 shows the system struc- 
ture of the system for controlling appliances. 
[0263] In FIG. 41 , those constituent items having the 
same functions as those in FIG. 26 are represented by 
the same symbols, and the description of which is omit- 
ted here. 

[0264] In the system for controlling appliances 508 In 
the present embodiment 8, a plurality of target applianc- 
es Is connected to HGW 110. In order to make descrip- 
tion simple, FIG. 41 shows only an IP human sensor 701 
and an IP camera 702, among the target appliances. 
[0265] Each of the target appliances is provided with 
built-in program module 704, 705 used for the control. 
[0266] Database section 1 05 of the server 1 01 In the 
present embodiment is provided with a complex control 
specifying table 706 for storing, when a complex control 
of plural appliances is specified, information about the 
specified details. Details of the complex control specify- 
ing table 706 will be described later. 
[0267] A method of controlling the appliances in ac- 
cordance with the present embodiment 8 is described 
below referring to FIG. 40. 



[0268] Description is made on an example of setting 
the control; where, as soon as the IP human sensor 701 
installed at entrance, among the target appliances, de- 
tects a human being, the IP camera 702 starts to take 
still images continually at an interval of 5 seconds and 
save the images. 

[0269] At step SI 701 , the appliances to which a user 
making access is entitled to control are extracted from 
the registered appliances table by means of registered 
ID of the user. The extracted appliances are exhibited 
overlapped on a layout drawing taken out of the visual 
map DB. Thus a Web page as shown in FIG. 42 used 
for selecting a target appliance is made available In ter- 
minal device 102 at the browser display means 113. 
[0270] In the Web page shown in FIG. 42, the icon 
images of appliances extracted after refening to the ap- 
pliances profile table are shown overlapped on a layout 
drawing 903, which has already been stored in the visual 
map DB 106. Namely, the Icon 901 of IP human sensor 
and the icon 902 of IP camera are shown, after making 
reference to such location infonnation as the location X, 
the location Y and the floor location, etc. stored in the 
registered appliances table 112. 
[0271] Now back to the FIG. 40, at step S1702, the 
user selects a plurality of appliances which are to be op- 
erating in the complex control mode. 
[0272] Actual procedure is; dragging the icon 901 of 
IP human sensor and the icon 902 of IP camera shown 
in FIG. 43 to a grouping zone 904 (the zone Is described 
as a setting box. In the drawing), and dropping them in 
there. 

[0273] At step S1703. whether an OK button 905 is 

pressed or not is judged; if judged pressed, the selecting 
operation judged finished and it proceeds to step SI 704. 
If it is judged not to have been finished, it is returned to 
step 81702. In the present example, the IP human sen- 
sor 701 and the IP camera 702 have been selected. 
[0274] At step SJ 704, a selection page for specifying 
the control items is exhibited, with a combination of the 
appliances selected at step SI 702. 
[0275] FIG. 44 shows an example 1001 of the above 
selection page for specifying the control items. Complex 
operations to be perfomied by the appliances selected 
at step SI 702 are listed in the page, to be selected by 
means of a pull down menu 1002. 
[0276] The complex operations are exhibited by read- 
ing out the appliance name stored in the registered ap- 
pliances table 112 and the function name infomnation 
stored In the appliances profile table 107, and combining 
these together. 

[0277] At the subsequent step S 1 705, user selects a 
complex operation by means of the pull down menu 
1002, and presses selection button 1003 to finish the 
selecting work. A complex operation selected in the 
present example is; entrance camera (IP camera 702) 
[save still image], upon [ON] of entrance sensor (IP hu- 
man sensor 701). 

[0278] AtstepS1706, a page for specifying the details 
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of the complex operation selected at step SI 705 is ex- 
hibited to the user. 

[0279] Practically, a page 1010 for specifying the de- 
tails as shown In FIG. 45 Is exhibited in tenminal device 
102 at the browser display means 113. 
[0280] In the page 1010 for specifying the details, an 
image 1013 taken by the IP camera 702 is exhibited. 
[0281] AtstepS1707, userpresses a detail specifying 
button 1011 white keep watching the image 1013. Thus 
the user specifies the resolution, the revolution angle 
and other details about the images to be saved. 
[0282] In the present exemplary embodiment, the de- 
tail specifying button 1011 is consisting of a plurality of 
buttons for controlling the IP camera 702. When the de- 
tail specifying button 1 01 1 is operated by a user, the ap- 
pliance URL, which being a network address informa- 
tion specifying IP camera 702 selected from the regis- 
tered appliances table, added with necessary command 
is sent to the program module 705 built In the IP camera 
702, in the same manner as described in the embodi- 
ment 7. The user can see an image 1013 every time 
when it is taken by IP camera 702 to detemnine an angle. 
The specifying operation can be finished by a press of 
an Image decision button 1012. 
[0283] After an image is decided by a press of the im- 
age decision button 1012, a page for specifying the au- 
tomatic complex control as shown in FIG. 46 is exhibit- 
ed. Describing practically, a text box for Inputting the 
[when to start] of starting the automatic complex control, 
a text display for displaying predetemriined condition 
[condition to start] which triggers the still image saving, 
an input text box for inputting [intervals] which indicates 
the interval time of still image saving, as well as those 
radio buttons for selecting time unit and related to the 
need of [e-mail acknowledge] which notifies start of the 
still images saving, and an input text box for inputting 
mail address of the notice mail appear in a confinmation 
window 1021, 

[0284] User specifies details of the automatic com- 
plex control by filling out the text boxes and selecting 
the radio buttons. Press of a decision button 1022 fin- 
ishes setting of the detailed conditions: then it proceeds 
to step SI 708. 

[0285] At step SI 708, a confimriatlon page is exhibited 
for conflnning the specified contents. 
[0286] FIG. 47 shows an example of the confinnation 
page 1020. The page exhibits an image 1013 taken by 
the IP camera 702 from the angle detenmlned at step 
SI 707, and a confimnation window 1021 in which the 
specified details are listed In a table. 
[0287] The confimriatlon window 1021 shows in the 
text box those information specified at the page for spec- 
ifying automatic complex control, FIG. 46. Particulars of 
the information have already been described at step 
SI 707 in FIG. 40, so the description of which is omitted 
here. 

[0288] If a user wishes to make a change, a try-again 
button 1032 may be pressed to have it retumed to the 



step SI 707. There, the user can make the setting once 
again. After that, if the user Is happy with what Is shown 
In the confinnation window 1021, he or she may select 
an OK conflnmed button 1031 to finish the confimnation 
5 of specified details. 

[0289] At step SI 709, a test operation page 1040 as 
shown in FIG. 48 is exhibited at a press of an operation 
test button 1030 of FIG. 47. 

[0290] If user presses a test operation start button 
1 041 , the test operation Is started; it is ended at a press 
of a test operation end button 1042. 
[0291] As soon as the test operation is started, 
present state of the test operation is shown in the test 
operation page 1 040 at the up right corner. State of the 
entrance sensor, number of still innages taken by the en- 
trance camera, confinnation of the images saved in the 
test operation, elimination of the images saved in the 
test operation, etc. are exhibited therein. 
[0292] in a case no test operation Is made at step 
SI 709, or the OK confirmed button 1 031 is selected at 
step SI 710 after a test operation is performed, the in- 
fomiation set at complex control specifying table 706 
shown in FIG. 41 is fixed and stored. 
[0293] FIG. 49 shows an example of the complex con- 
trol specifying table 706 in the present invention. 
[0294] Each of the lines of the complex control spec- 
ifying table 706 shown in FIG. 49 stores infomiation 
specified with respect to the complex control. 
[0295] The Complex control ID represents an ID 
number given to the complex control in the order of reg- 
istration, the Registered user ID represents an individual 
user ID. In the column SETEND, a numeral 1 is written- 
in after a relevant control operation set therein Is totally 
finished. 

[0296] lnthecolumnFORGEEND,anumeral1 iswrit- 
ten-in when an ongoing control operation set therein is 
forced to temiinate. In the Start date and time[Date], the 
date and time of control start registered by user is writ- 
ten. In the Appliances countfNumber], a number of ap- 
pliances selected Is written. In the column Appliance 1 
[Appl. 1 ], an appliance ID registered in the registered ap- 
pliances table 112 corresponding to name of an appli- 
ance (e.g. entrance sensor) selected by user among the 
target appliances is registered. In the Appliance 1 con- 
ditlon[Appl.1 condition], time-wise condition of output 
from the Appliance 1 is registered: wherein, 'hold' 
means the time for holding the condition after the value 
in the column Appliance 1 genuine output [Appl.l out- 
put] is first reached, 'interval' means the output interval 
time after a first output Is generated. 
[0297] The initial value of [tempi ] represents starting 
date and time. When Appliance 1 outputs the genuine 
output of Appliance 1 at the Appliance 1 control, the 
sen/er registers a date and time in the column tempi , 
which date and time consisting of the time written in the 
column Appliance 1 condition plus the present date and 
time. The Appliance 1 control [Appl.l control] represents 
name of the function selected by user with the first target 
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appliance. The Appliance 1 genuine output represents 
genuine value which is applied when the function output 
written in the column Appliance 1 control is used for the 
division criterion. The Final output save[Save] shows 
whether or not the final output result is saved in the serv- 
er. The Mail notice[Email acknowledge] stores mailing 
address used when notifying by mail. 
[0298] The finish date and time is that which is regis- 
tered by user when the control Is finished. 
[0299] Namely, in the complex control specifying table 
706 in FIG. 49, the description in the uppermost line 
(complex control 10^1) represents the contents of a 
specified complex control, which Is indicating that; it is 
the case of automatic control ID:1 specified by a regis- 
tered usera ID:1, from 7:00 hour on July 7 to 7:00 hour 
on July 8. 2001 . still Image of entrance camera is saved 
for 5 min. at an interval 5 sec. upon the output from reg- 
istered appliance ID:2, a entrance sensor, is turned ON, 
and the outcome Is notified to usera @ ip#servlce.com . 
[0300] The second line (complex control ID=2) of the 
complex control specifying table 706 in FIG. 49, indi- 
cates a complex control that; it is specified by a regis- 
tered userb I D:2, from 22:00 hour on July 1 7 to 8:00 hour 
on July 18, 2001 . still Image output from registered ap- 
pliance ID:3, a living room CAM, Is saved at an interval 
10 min., and the outcome Is notified to usert)@ip#sefv- 
ice.com. 

[0301] As described in the foregoing, a tenninai de- 
vice 1 02 makes access to the server 101, and the server 
101 takes part of the entire control of appliances 111 , in 
the present invention. With this system configuration, a 
complex control of a plurality of appliances 111, which 
was difficult because of a limitation in the capability with 
the HGW 110, can be realized with ease by the use of 
a server 1 01 that Is provided with a high processing ca- 
pacity. 

[0302] In the present exemplary embodiment, the 
complex control of appliances has been specified 
through the work of drag-and-dropping the icons of a 
plurality of appliances 111 in the grouping zone. How- 
ever, the present invention is not limited to the above- 
described way of operation. The present invention may 
of course be applied to the complex operation of the ap- 
pliance; a television receiver at one side and a video 
recorder at the other side, for example, can be automat- 
ically started for a complex operation, such as video- 
recording, etc. by the work of drag-and-dropping the 
icons of plurality of appliances 1 11 in the grouping zone. 
[0303] In the present exemplary embodiment, the 
complex control of appliances and the operation have 
been specified through the work of drag-and-dropping 
the icons of a plurality of appliances 111 in the grouping 
zone. However, the apparatus and system for control- 
ling appliances in the present Invention is not limited to 
the above-described way of operation. The present In- 
vention may of course be applied to such a structure, 
where the work for specifying a complex control or op- 
eration of appliances is conducted by, for example. 



drag-and-dropping the icon of one appliance on the icon 
of other appliance. 

(Embodiment 9) 

IP304] The system structure of a system for control- 
ling appliances in a ninth exemplary embodiment of the 
present Invention remains the same as that of the sys- 
tem for controlling appliances 508 in the embodiment 8. 
[0305] The point of difference as compared to the em- 
bodiment 8 is that the visual map DB 106 in the present 
embodiment 9 stores the DXF and the like vector data. 
[0306] In the present system for controlling applianc- 
es, the work for selecting the appliance for complex con- 
trol is not a user's responsibility. In addition, a complex 
operation, which was conventionally difficult can also 
be perfomied. Thus the present embodiment provides 
special advantages, on top of those provided in the em- 
bodiments 5 through 8. 

[0307] Detailed description follows with reference to 
the drawings. 

[0308] The DXF and the like vector data 1 050 in the 
present embodiment 9 (hereinafter referred to as vector 
data) Is a text data as shown In FIG. 50. 
[0309] The vector data 1050 in FIG. 50 represents a 
room layout drawing shown in FIG. 52. This data is tell- 
ing to a user [usera] the information about appliances 
placed in first floor of the building, which information Is 
stored In the visual map DB 106 under the file name 
[useralf.txt]. The file name indicates that it is first floor 
data of a user [usera]. 

[031 0] Each line of the vector data 1 050 describes in- 
fonnation about respective rooms where the appliance 
is to be placed. 

[0311] The portion in FIG. 50 confined by dotted lines 
is used as an example. It reads; 
Room. LD, 7, 450. 90, 720. 90. 720. 810, 360. 810. 360. 
270, 460, 270, 450, 90 

This data represents the room LD circled with dotted 
lines, among rooms shown In FIG. 52. 
[031 2] The starting item [ROOM] indicates property of 
a target object, such as room, while the next item [LD] 
indicates name of the room. 

[0313] As to the property of object, if the object is a 
room It can be [Room], If the object Is furniture It can be 
[Fumiture]. Any way, it indfeates what the object is. 
[031 4] The next n umeral [7] represents the number of 
room comers plus 1. In the present example, it means 
that the room of property Room with a name LD has six 
comers. 

[0315] The subsequent description [450. 90, 720, 90, 
720. 810, 360, 810. 360. 270. 450. 270. 450. 90] indi- 
cates, with a couple of numerals, coordinates of each of 
the corners. 

[0316] Namely, the first couple of numerals [450. 90] 
represent the X coordinate and the Y coordinate of the 
comer 1 . with the top left corner of FIG. 52 as the point 
zero. The next couple [720, 90] represents the comer2, 
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[720, 810] the corner 3, [360, 810] the comer 4, [360, 
270] the comer 5, [450. 270] the comer 6, and the test 
[450, 90] represents once again the corner 1 coordi- 
nates. 

[0317] By linking these coordinates data; the shape 
of an object, e.g. target room, is detemiined. 
[031 8] User can input these data beforehand through 
the drag-and-drop using a mouse or the like pointing de- 
vice. Or, It can be read-In from the visual map DB 106. 
[0319] Under the above-configured structure, when 
an icon of target appliance Is disposed to the place by 
user, the processing means makes reference to the in- 
formation about location X and location Y in the regis- 
tered appliances table 1 1 2 shown In FIG. 51 , and an ob- 
ject, e.g. a room in which the target appliances are 
placed, is determined by the vector data 1050. 
[0320] in the bottom line of registered appliances ta- 
ble 112 in FIG. 51. for example, an infomiation usera/ 
group/1 f1d/cam02 is stored In the grouping infonnatlon 
column of registered appliance ID No. 4. 
[0321] This indicates the grouping InfonTiatbn of a us- 
er [usera] is telling that it is the second IP camera for 
the usera, placed in the Id at 1 F. 
[0322] Thus the grouping information as to where a 
target appliance is placed is stored by each of the target 
appliances. By so doing, when conducting a complex 
action as exemplified in embodiment 8, only the appli- 
ances locating In the same room can be extracted by 
refen'Ing to the grouping Infomriation, to facilitate selec- 
tion of target appliance. This makes It possible to realize 
a new complex action that was impossible before, at the 
same time it alleviates the burden of users. 
[0323] A practical example; suppose an IP camera is 
installed in a certain room to subdue a doubtful intruder, 
the IP camera is panning at a regular cycle for detecting 
a moving object. The direction of panning Is stored as 
panning infomfiation In the registered appliances table 
112. When a moving object is detected by the IP cam- 
era. It acquires information about the relative location 
between the room In which the IP camera is installed 
and the surrounding rooms, from the vector data. By 
making reference to the panning information as of the 
moment when the moving object was detected, the 
room where the moving object is detected is made 
known. 

[0324] An IP light locating at the room may be set to 
turn ON, for subduing the intruder 
[0325] On top of the advantages as described in the 
embodiments 5 through 8. a system for controlling ap- 
pliances In the present embodiment 9 can store any de- 
sired infonnatlon in the registered appliances table 112. 
such as the information for specifying a room where an 
appliance is locating, the information about panning of 
appliance, etc. A combination of these advantages en- 
ables a new complex operation integrating Individual ap- 
pliances, which complex operation being impossible un- 
der the conventional concepts, without posing too much 
burden on the user side. 



INDUSTRIAL APPLICABILITY 

[0326] The present invention offers an apparatus and 
system for controlling appliances, with which apparatus 

5 and system the work for data downloading that arises 
when a new appliance is added to, the existing appli- 
ance is changed, or a controllable function of existing 
appliance is modified can be reduced to a minimum. 
Thus the burden levied on the users and system oper- 

10 ators is alleviated, and the memory media resources are 
utilized at a highest efTiciency without leaving wasting 
portion. 



15 Claims 

1 . An apparatus for controlling appliances, connecta- 
bla with a terminal device and a singular or a plu- 
rality of appliances, which appliances being target 

20 of the control; comprising 

memory means storing program components 
for fomning an application which makes said target 
appliance execute a certain specific function, and 
application generation means which selects 

25 certain program component from among those 
stored in said memory nrieans in accordance with 
instruction sent by said terminal device, which pro- 
gram component being essential for executing a 
certain specific function of appliance selected by 

30 said instruction, and generates a certain specific 
application. 

2. The apparatus for controlling appliances recited in 
claim 1 , wherein 

35 said memory means further comprises a us- 

ers table storing infomnation for Identifying the us- 
ers, a target appliances table which stores informa- 
tion regarding target appliance by each of said us- 
ers, and a devices information table which stores 

40 information regarding perfomnabte function by each 
of said target appliances; and 

said application generation nneans generates 
said certain specific appltoation based on infomna- 
tion stored in said users table, said target applianc- 

45 es table and said devices information table. 

3. The apparatus for controlling appliances recited in 
claim 1 or claim2, wherein 

said memory means further comprises a con- 
50 trol command table which stores infontiation about 
control command of each function of said target ap- 
pliances, and 

said application generation means transmits 
to said selected appliance a control command that 
55 conforms to said selected appliance based on infor- 
mation stored in said control command table. 

4. The apparatus for controlling appliances recited in 
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any one of claim 1 through claims, wherein 

said temiinal device comprises a browser dis- 
play section, and 

said program component contains a button 
display program for displaying an operation button 
relevant to said function in said browser display sec- 
tion of said temiina! device by each of functions of 
said target appliances, and a control command pro- 
gram for transmitting control orderto said target ap- 
pliance. 

5. The apparatus for controlling appliances recited in 
claim 4, wherein said control command program is 
described in PHP language. 

6. The apparatus for controlling appliances recited in 
claim 4 or cialmS, wherein said button display pro- 
gram Is described in a code that confomrts to said 
browser display section of said tenninal device. 

7. The apparatus for controlling appliances recited in 
claim 6, further comprising temninal identifying 
means for identifying the Idnd of said terminal de- 
vice. 

8. A system for controlling appliances comprising: 

a tenminai device; 

a singular or a plurality of appliances, which be- 
ing target of the control; 
memory means storing program components 
to be used for fomning an application for exe- 
cuting a certain specific function of said target 
appliance; 

application generation means which selects 
certain program component from among those 
stored in said memory means in accordance 
with instruction sent by said terminal device, 
which program component being essential for 
executing a certain specific function of appli- 
ance selected by said instruction, and gener- 
ates a certain specific application; and 
a server which transmits control command cor- 
responding to said instruction to said selected 
appliance. 

9. The system for controlling appliances recited in 
claim 8, wherein 

said memory means further comprises a us- 
ers table storing infomfiation for identifying the us- 
ers, a target appliances table which stores informa- 
tion regarding target appliance by each of said us- 
ers, and a devices infomnation table which stores 
information regarding the performable function by 
each of said target appliances; and 

said application generation means generates 
said certain specific application based on informa- 
tion stored in said users table, said target applianc- 



es table and said devices infomnation table. 

10. The system for controlling appliances recited in 
claim B or clalm9, wherein 

5 said memory means further comprises a con- 

trol command table which stores infonmation about 
control command by each function of said target ap- 
pliances; and 

said application generation means transmits 

10 to said selected appliance a control command that 
confomns to said selected appliance based on infor- 
mation stored in said control command table. 

1 1 . The system for controlling appliances recited In any 
IS one of claim 8 through claim 10, wherein said ter- 
minal device and said sen/er are connected via a 
global network. 

12. The system for controlling appliances recited In any 
20 one of claim 8 through claim 1 1 , wherein said appli- 
ances and said server are connected via a global 
networl<. 

13. The system for controlling appliances recited in an^ 
25 one of claim 8 through claim 12, wherein said ter- 
minal device comprises a browser display section 
for displaying a Web page. 

14. The system for controlling appliances recited In any 
30 one of claim 8 through claim 13, wherein said ap- 
pliances are provided with WWW server 

1 5. The system for controlling appliances recited in any 
one of claim 8 through claim 14, wherein 

35 said program component contains a button 

display program for displaying an operation button 
relevant to said function in said browser display sec- 
tion of said tenminai device by each of functions of 
said target appliances, and a control command pro- 

40 gram for transmitting control orderto said target ap- 
pliance. 

16. The system for controlling appliances recited in 
claim 1 5. wherein said control command program 

45 is described In PI-IP language. 

17. The system for controlling appliances recited in 
claim 15 or claim 16, wherein said button display 
program is described in a code that confomns to said 

50 browser display section of said terminal device. 

18. The system for controlling appliances recited in 
claim 17, further comprising terminal identifying 
means for identifying the kind of said temiinai de- 

55 vice. 

19. An apparatus for controlling appliances comprising 

a registered appliances table which stores in- 
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fomnation including the network address infonna- 
tion and the layout location infoonation about the 
target appliances; 

an appliances profile table which stores Infor- 
mation by each of the functions of said appliances, 
including the control command for executing said 
function of said appliance, and the icon infoonation 
of said appliance; 

a database section containing a visual map 
database which stores layout information about a 
place in which said appliance is to be located; 

interface means for transmitting control com- 
mand to said appliance for controlling said appli- 
ance; and 

Web page generation means for generating a 
Web page, by acquiring said layout drawing infor- 
mation from said visual map database, said icon in- 
fonnation from said appliances profile table, said lo- 
cation Infonnatlon from said registered appliances 
table, and displaying the icon image of said appli- 
ance overlapped on the drawing of said layout in- 
formation. 

20. The apparatus for controlling appliances recited In 
claim 19, wherein said layout drawing information 
is described in the vector data by each of the objects 
where said appliance is to be located, and said reg- 
istered appliances table further contains Infomna- 
tion Indicating an object where said appliance is lo- 
cated. 

21. The apparatus for controlling appliances recited in 
claim 1 9 or claim20, wherein, upon a clicking made 
on said icon image exhibited in said Web page, said 
Web generation means generates an appliance- 
wise Web page containing Icon, or button, of con- 
trollable functions with said appliance. 

22. The apparatus for controlling appliances recited in 
any one of claim 19 through claim21 , wherein said 
Web generation means generates a page provided 
for selecting and specifying the control item, with 
which page a complex control, or specifying of such 
control, of integrated functions to be performed by 
collaboration with relevant appliance can be made 
by drag-and-dropping beforehand the icon image of 
said relevant appliance in a grouping zone provided 
in said Web page. 

23. The apparatus for controlling appliances recited in 
any one of claim 1 9 through claim21 , wherein 
said Web generation means generates a page pro- 
vided for selecting and specifying the control item, 
with which page a complex control, or specifying of 
such control, of Integrated functions to be per- 
formed by collaboration of a plurality of appliances 
can be made by drag-and-dropping icon image of 
one appliance on other icon image of the other ap- 



3fr 
pliance. 

24. A system for controlling appliances comprising: 

5 a home gateway connected to a global network; 

' a singular or a plurality of appliances, which be- 
ing target of the control, connected to said 
home gateway forming a local networt(; 
a registered appliances table which can be con- 

10 nected to said global networi<, which table stor- 

ing information including the networi< address 
infonnation and the location Information about 
said target appliances; 

an appliances profile table which stores Infor- 
ms mation by each of the functions of said appli- 
ances, Including the control command for exe- 
cuting said function of said appliance, and the 
icon infonnation of said appliance; 
a database section containing a visual map da- 
20 tabase which stores layout information about a 
place in which said appliance is to be located; 
interface means for transmitting control com^ 
mand to said appliance for controlling said ap- 
pliance; 

25 a server comprising Web page generation 

means for generating a Web page, by acquiring 
said layout drawing infomnationfrom said visual 
map database, said icon infomnation from said 
appliances profile table, said location Infonna- 
30 tion from said registered appliances table, and 

displaying the icon image of said appliance 
overiapped on the drawing of said layout infor- 
mation; and 

a terminal device connected to said global net- 
35 wori<, which terminal device having browser 

display means which can exhibit said Web 
page;' wherein 

said terminal device makes access to said serv- 
er to have said Web page generated by Web 
40 generation means of said server exhibited In 

said terminal device at the browser display 
means, and when said temiinal device is oper- 
ated said networi< address infonnation is re- 
ferred via interface means of said server and a 
45 control command is transmitted to said appli- 

ance. 

25. The system for controlling appliances recited in 
claim 24, wherein said layout drawing infonnation 

50 Is described In the vector data by each of the objects 
where said appliance Is to be located, and said reg- 
istered appliances table further contains informa- 
tion indicating an object where said appliance is lo- 
cated. 

55 

26. The system for controlling appliances recited in 
claim 24 or claim25. wherein, upon a citeking made 
on said icon image exhibited in said Web page, said 
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Web generation means generates an appliance- 
wise Web page containing icon, or button, of con- 
trollable functions with said appliance. 

27. The system for control ling appliances recited in any 5 
one of daim 24 through clalm26. wherein said Web 
generation means generates a page provided for 
selecting and specifying the control item, with which 
page a complex controi, or specifying of such con- 
trol, of integrated functions to be performed by col- io 
laboration with relevant appliance can be made by 
drag-and-dropping beforehand the icon image of 
said relevant appliance in a grouping zone provided 

in said Web page. 

15 

28. The system for controlling appliances recited in any 
one of claim 24 through claim26, wherein 

said Web generation means generates a page pro- 
vided for selecting and specifying the control Item, 
with which page a complex control, or specifying of 20 
such control, of integrated functions to be per- 
fomried by collaboration of a plurality of appliances 
can be made by drag-and-dropping Icon image of 
one appliance on other icon image of the other ap- 
pliance. 25 
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FIG. 8 
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FIG. 9 



<?PHP 

if($move=="f){ 

@fopen("$deviceURL/cgi-bin/ControlCamera?Directlon=TiltUp" , "r"); } 
if($move==''^"){ 

@fopen("$deviceURIJcgi-bin/CaritFolCamera?Direction=PanLeft" , V); } 
lf($move ==•-►"){ 

@fopen("$deviceURL/cgi-bin/ControlCamera?pirection=PanRight" , T); ) 
if($move==-i'){ 

@fopen("$devlceURL/cgi-bin/ControlCamera?Direction=TiltDown' , Y); } 
?> 
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FIG. 11 
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FIG. 16 



<?PHP 

$ua = $HTTP_USER_AGENT; 
if{ereg("DoCoMo",$ua)){ 
headerCLocation: 7i/i.php'); 

exit; 

}elseif(ereg('J-PHONE",$ua)){ 
header("Location: /j/j.php"); 
exit; 

}elseif(ereg{"UP¥.Browser",$ua)){ 
header("Location: Vez/ez-php"); 
exit; 

}eIseif(ereg('PDXGW".$ua)){ 
headerCLocation: 7h/h.php"); 

exit; 
)else{ 

headerCLocation: index.php"); 
exit; 

} 

?> 
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FIG. 18 



<FORM action= target URL> 

< INPUT type=Submit name=act value=ON> 

<INPUT type=Submit name=act value=OFF> 

</FORM> 
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<?PHP 

if($act== W){ 

@fopen(''$deviceURLycgi-bin/Control?Action=ON' . V); 
} 

if($act=="OFF'){ 

@fopen('$devlceURLycgl-bin/Control?Action=OFF" , Y); 
} 

?> 



FIG. 21 



<FORM aclion=target URL> 

<INPUT type=Submit name=move value* t ><BR> 

<INPUT type=Submit nafne=move values'«-> 

<INPUT type=Submit name=move value=-*><BR> 
<INPUT type=Submit name=move value= i > 
</FORM> 
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FIG. 26 
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FIG. 29 
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FIG. 32 
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FIG. 33 
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FIG. 36 
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FIG. 37 
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FIG. 38 



<mapname='image1'> 

<area codes='000.000,050.025' href='psnapindex.php3?P=-3&T=4&C=cont&camurl=http: 
^/cam01_usera.ip_service.com&Resolution=320x240'> 

<area codes='05di000,1O0.025' hrefs'psnapindex.php3?P=-2&T=4&C=cont&camurl=http7 

/cam01_usera.ip_service.com&Resolution=320x240'> 

<area codes='1 00,000, 1 50,025' href="psnapindex. php3?P=-1 &T=4&C=cont&camurl=hltp:/ 
fcam01_usera.ip_service.com&Resolution=320x240'> 

<areacodes='150,000,170,025' href='psnapindex.php3?P=0&T=4&C=cont&camurl=http:/ 

fcam01_usera.ip_service.com&Resolution=320x240'> 

<areacodes='170,000,220,025'href='psnapindex.php3?P=10&T=4&C=cont&camurl=httpy/ 
cam01_usera.ip_service.com&ResoIution=320x240'> 

<areacodes-220.000,270,025'hrefs'psnapindex.php3?P=2&T=4&C=cont&camuri=http:// 

cam01_usera.ip_service.com&Resolution=320x240'> 

<afeacodes='270,000,320,025' href='psnapindex.php3?P=3&T=4&C=cont&camurl=htlp:// 
cam01_usera.ip_service.com&Resolution=320x240'> 

(abbreviated) 

</map> 
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FIG. 40 



C 



Start 



Display appliances 



1 



Select appliances 





31701 
S1702 




Display selection page 



[ Select complex operation 



SI 703 

-SI 704 
81 705 



Display Web page for 
selected complex operation 



I 



Detail specifying button is 
pressed 



SI 706 



SI 707 



Display confirmation page 



SI 708 



SI 709 




Test operation 



S1711 



54 



EP1 416 760A1 




55 




56 



EP1 416 760A1 




EP1 416 760A1 




(0 

o 

CD 

E 

3 

3 
(0 



O 

V. 

B 

O 

'a 

o 

CO 

I- 



o o 
E a 

Jar 



I- O 



w « c 

I B B 

> > > 

<0 <0 CO 

CX d CL ' 

.52 .52 ^ 

b Q O LU 



c 
o 

•■8 

CO 



c 
o 

■« 

-S 

(0 



58 



EP 1 416 760 A1 



2 

E 

ca 
o 

■D 
C 
(0 



o 

in 
C 

o 
w 

0> 

o 
c 

I 

a> 
i/i 

Q> 

w 
3 

c 

3 

I 

c 
o 
o 



CO 

E 

B 

3 
CO 

■ c 
o 

0) 
CO 



o 

in 



O 

Ui 

c 
a> 

in 

c 

0) 



2 
E 

CO 

o 

2 

I 
o. 
o 

f2 



2 

D 
U 

c 

'I 

CO 
0) 

"o 
a> 
O 

0} 



=5 « ^ 
o 



CO 



2: 









in 








ture 




tting 








o 




o 








a 




CO 










CNJ 


o 
c 


CO 






-o 




Q. 






"o 


UJ 


CO 


UJ 




o 




x: 


1- 


0) 




p 




O 




±1 



<1> 



0) 

-g 
"o 



59 




EP1 416 760 A1 



csi 
O 




80 



EP 1 416 760 A1 



csi 

CO 

o 



(0 
i- 

E 

CO 

o 
c 

(0 
k. 

o 
(/) 
c 

03 
« 

o 
c 

2 

c 

03 



u 
0) 

(0 

bO 

.£ 

3 
"O 

c 
o 
o 

_> 

"co 
o 

E 

I 

c 
o 

q> 
CO 



O 



o 

CO 

c 

CO 

c 



0> CO 



O 

> 
jO 

B 

O 
.0' 



03 
00 










c/) 








£ 




etc 
c 




















1 
























'5. 




CO 








o 


CM 


0) 

c 


CO 




-o 


CL 


CL 




LU 


'5 


LU 


CO 


LU 


CO 




o 


1- 






<D 




o 


CO 


O 


CO 











> 










/ 














/ 














i 

f 






















o 




o 














o 


















utes 














c 






CD 








E 






O 




Q 


O 

CO 


in 




■ E 

8 


§ 




o 


\ 


03 












ensoj 


Aft 


need 


ip.service 






o 


« < 


D 
0 


o 




301Y 


/hen tl 




no 


@) 

2 

03 
c/> 


2001Y 












ZD 












0> 








\ 


ti 




hi 
"D 




f 
1 




\ 

1. . 




c 


03 




f 




tart' 


(0 


03 










O 


o 

•4-' 


cno 




'C 






■ c 


c 


o 




43 




c 


ditio 


^ o 
^ "2 


ail a 


/ 


c 








13 C 


E 


/ 


C3 








^ O 




/ 








: 


5 O 


A, 


f 


i 





c 

'cO 

CTJ 

03 
O 

c 
O 



CO 

o 



CO 



CM 
O 



o 



o 

CO 

o 



61 



EP1 416 760A1 



CM 

Z 



GO 

d 

LL 



2 

Q> 

E 

CO 

o 

-o 
c 

o 
c 

i 

<M CO 

c c 
V c 

ID 01 

c 

3 



CO 



o 

CO 

c 

(O 

0> 
O 

c 

I 

LJJ 



0) 

I 



I 
"a 

(0 



o ^ 



E 

3 



.1 

Q. 
■M 
CO 
01 



I 

o 
o 

2^ 
To 
o 

E' 
o 

(0 



o 
-£ 

o> 
CO 



O CO 

S Si 

3 

IS 
5. 

4> 





CO 

o 







— 












/ 

/ 








\ 

\ 














\ 
















o 














c? 






















CO 








cz> 






minul 






&^ 

O 


o 


O 




m 




E 

8 


C30 




w 








O 
















CD 


le sensoi 


o 

0> 




need 


D service 




>- 

1 


c 
a> 


in 




o 
c 


@ 

£2 
a> 

CO 


2001Y 












r> 


















1 


ti 












1 






c 






/ 


start" 


CO 










/. 


o 
■«-» 

c 




5 

C 


ckno 




Q> 




o 


CO 


O 


CD 








+3 








4 




C 






i 


C 


0) 


c 




c 




/ 










o 




/ 






c3, 




O 









CO 

c 

UJ 



CO 
0) 

■e 



o 



62 




EP1 416 760A1 



Appl.1 
output 


1 NO 






Appl.1 
control 


Sensor output 


Picture output 




tempi 


200107070700 


200107172200 




Appl.1 
condition 


HoldSmin 


IntervallOmin 




<C 


CM 








CM 






Date 


200107070780 


200107172200 




;end 








FORCE 


O 


O 




LTEND 


o 


o 




CO 








o 








User 




CM 




control 
ID 




CN4 


CO 



o 



TO 

E 



a> 
>• 

CO 



8 

o 



E 

8 



CO 



CO 

a> 



CO 



I I 



CM 



<M 

is 



CVJ 
O. 

E 



^ 2 

< § 



< 



O 

o 



O 
CD 

o 
o 

o 

o 

CM 



o 

CM 
CM 

o 

5 
o 

CM 



O 
CD 
CO 

I 

CD 



63 



EP 1 416 760 A1 



FIG. 50 
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